Sep 18 04:21:01.144306 ip-10-0-132-31 systemd[1]: Starting Kubernetes Kubelet... Sep 18 04:21:04.330203 ip-10-0-132-31 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 04:21:04.330203 ip-10-0-132-31 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 04:21:04.330203 ip-10-0-132-31 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 04:21:04.330203 ip-10-0-132-31 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 04:21:04.330203 ip-10-0-132-31 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 04:21:04.331011 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.330278 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 04:21:04.333695 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333677 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:21:04.333695 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333694 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333698 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333702 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333706 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333709 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333712 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333715 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333722 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333726 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333729 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333733 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333737 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333740 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333743 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333745 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333748 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333751 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333753 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333756 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:21:04.333763 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333758 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333761 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333764 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333767 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333770 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333773 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333775 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333778 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333781 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333784 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333786 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333789 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333792 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333795 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333797 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333800 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333802 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333805 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333807 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333810 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:21:04.334234 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333813 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333817 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333821 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333824 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333827 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333829 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333832 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333834 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333837 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333839 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333842 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333844 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333847 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333849 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333852 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333855 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333857 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333860 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333862 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333865 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:21:04.334725 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333867 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333870 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333872 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333875 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333877 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333880 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333882 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333885 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333887 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333890 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333893 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333896 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333898 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333901 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333904 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333907 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333911 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333914 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333917 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:21:04.335216 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333920 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333922 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333925 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333927 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333929 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333932 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333935 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333937 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333940 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333942 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333945 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333948 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333950 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333953 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333956 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333958 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333961 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333963 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333966 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.333969 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334684 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:21:04.335682 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334691 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334694 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334697 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334700 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334703 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334705 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334709 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334711 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334714 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334717 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334719 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334722 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334724 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334727 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334730 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334733 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334736 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334738 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334741 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334744 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:21:04.336225 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334747 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334750 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334752 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334755 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334758 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334762 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334766 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334769 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334772 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334775 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334778 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334781 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334785 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334788 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334791 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334793 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334796 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334799 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334801 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334804 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:21:04.336729 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334807 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334810 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334812 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334815 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334817 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334820 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334822 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334825 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334828 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334830 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334833 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334836 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334838 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334841 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334843 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334846 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334849 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334851 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334854 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:21:04.337227 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334856 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334859 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334861 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334864 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334866 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334869 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334871 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334874 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334876 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334879 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334882 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334884 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334887 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334890 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334893 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334895 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334898 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334900 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334904 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334906 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:21:04.337719 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334909 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334911 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334914 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334917 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334919 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334922 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334925 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334929 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334932 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334935 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334938 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334941 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334944 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334947 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334950 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334952 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334955 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334958 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.334960 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:21:04.338232 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335406 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335414 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335419 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335423 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335426 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335431 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335435 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335438 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335440 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335443 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335446 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335448 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335451 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335454 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335456 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335459 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335462 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335464 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335467 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335470 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:21:04.338692 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335472 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335476 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335480 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335484 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335488 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335491 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335494 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335497 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335499 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335502 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335505 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335508 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335511 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335514 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335517 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335519 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335522 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335525 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335529 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:21:04.339311 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335532 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335534 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335537 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335539 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335542 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335545 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335548 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335550 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335553 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335555 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335558 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335561 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335563 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335566 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335569 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335572 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335574 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335577 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335580 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:21:04.339775 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335582 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335585 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335587 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335590 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335592 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335595 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335597 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335600 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335603 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335605 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335608 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335611 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335614 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335617 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335620 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335622 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335625 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335627 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335631 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:21:04.340244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335634 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335637 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335640 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335643 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335646 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335648 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335652 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335654 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335657 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335660 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335662 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335664 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335667 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335670 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335672 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335675 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335677 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335680 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335683 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335686 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:21:04.340730 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335688 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.335691 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335759 2562 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335801 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335810 2562 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335815 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335819 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335822 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335827 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335831 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335834 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335837 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335841 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335844 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335847 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335851 2562 flags.go:64] FLAG: --cgroup-root="" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335854 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335857 2562 flags.go:64] FLAG: --client-ca-file="" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335860 2562 flags.go:64] FLAG: --cloud-provider="external" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335863 2562 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335867 2562 flags.go:64] FLAG: --cluster-domain="" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335870 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335873 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335876 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 04:21:04.341230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335879 2562 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335883 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335886 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335889 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335892 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335896 2562 flags.go:64] FLAG: --contention-profiling="false" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335899 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335902 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335905 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335907 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335911 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335914 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335919 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335921 2562 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335925 2562 flags.go:64] FLAG: --enable-server="true" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335928 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335933 2562 flags.go:64] FLAG: --event-burst="100" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335937 2562 flags.go:64] FLAG: --event-qps="50" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335940 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335943 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335946 2562 flags.go:64] FLAG: --eviction-hard="" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335950 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335953 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335957 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335960 2562 flags.go:64] FLAG: --eviction-soft="" Sep 18 04:21:04.341794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335963 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335966 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335969 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335972 2562 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335975 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335978 2562 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335981 2562 flags.go:64] FLAG: --feature-gates="" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335985 2562 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335988 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335991 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335994 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.335998 2562 flags.go:64] FLAG: --healthz-port="10248" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336001 2562 flags.go:64] FLAG: --help="false" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336004 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336008 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336011 2562 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336014 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336017 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336020 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336025 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336039 2562 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336043 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336046 2562 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 04:21:04.342449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336050 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336064 2562 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336068 2562 flags.go:64] FLAG: --kube-reserved="" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336071 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336074 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336077 2562 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336080 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336083 2562 flags.go:64] FLAG: --lock-file="" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336086 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336089 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336092 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336097 2562 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336100 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336103 2562 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336106 2562 flags.go:64] FLAG: --logging-format="text" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336109 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336112 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336115 2562 flags.go:64] FLAG: --manifest-url="" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336118 2562 flags.go:64] FLAG: --manifest-url-header="" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336122 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336125 2562 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336129 2562 flags.go:64] FLAG: --max-pods="110" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336132 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336135 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336138 2562 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 04:21:04.343048 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336141 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336144 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336147 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336150 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336158 2562 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336161 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336164 2562 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336169 2562 flags.go:64] FLAG: --pod-cidr="" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336171 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336178 2562 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336182 2562 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336185 2562 flags.go:64] FLAG: --pods-per-core="0" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336188 2562 flags.go:64] FLAG: --port="10250" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336191 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336194 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a1df9bcfba31ee84" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336197 2562 flags.go:64] FLAG: --qos-reserved="" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336200 2562 flags.go:64] FLAG: --read-only-port="10255" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336203 2562 flags.go:64] FLAG: --register-node="true" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336206 2562 flags.go:64] FLAG: --register-with-taints="" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336209 2562 flags.go:64] FLAG: --registry-burst="10" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336212 2562 flags.go:64] FLAG: --registry-qps="5" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336216 2562 flags.go:64] FLAG: --reserved-cpus="" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336218 2562 flags.go:64] FLAG: --reserved-memory="" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336222 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336225 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 04:21:04.343831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336228 2562 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336231 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336234 2562 flags.go:64] FLAG: --runonce="false" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336237 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336241 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336244 2562 flags.go:64] FLAG: --seccomp-default="false" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336247 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336250 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336253 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336256 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336259 2562 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336264 2562 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336267 2562 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336270 2562 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336273 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336277 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336280 2562 flags.go:64] FLAG: --system-cgroups="" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336283 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336289 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336292 2562 flags.go:64] FLAG: --tls-cert-file="" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336295 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336299 2562 flags.go:64] FLAG: --tls-min-version="" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336302 2562 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336305 2562 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336308 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 04:21:04.344781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336311 2562 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336314 2562 flags.go:64] FLAG: --v="2" Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336318 2562 flags.go:64] FLAG: --version="false" Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336322 2562 flags.go:64] FLAG: --vmodule="" Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336326 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336329 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336446 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336450 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336453 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336455 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336458 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336461 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336464 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336466 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336469 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336472 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336474 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336477 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336481 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336484 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336487 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336489 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:21:04.345422 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336493 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336496 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336498 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336501 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336505 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336507 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336510 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336513 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336516 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336520 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336524 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336526 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336529 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336532 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336535 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336537 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336540 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336542 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336545 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:21:04.345965 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336547 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336550 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336553 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336556 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336558 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336561 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336564 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336566 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336568 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336574 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336576 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336579 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336582 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336586 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336589 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336591 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336594 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336597 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336600 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336602 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:21:04.346456 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336605 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336608 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336610 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336613 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336615 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336618 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336621 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336623 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336626 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336629 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336631 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336634 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336636 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336639 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336641 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336644 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336648 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336652 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336655 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:21:04.346945 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336658 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336660 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336665 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336669 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336672 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336675 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336680 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336682 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336685 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336688 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336690 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336693 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336696 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336699 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336702 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336704 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336707 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336710 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336712 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:21:04.347419 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336715 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336717 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336720 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336723 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336725 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.336728 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.336736 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.344957 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.344972 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.344992 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.345002 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345072 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345078 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345081 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345084 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:21:04.347884 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345087 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345090 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345092 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345095 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345098 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345101 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345103 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345106 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345109 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345112 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345114 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345117 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345119 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345122 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345125 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345127 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345130 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345133 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345136 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345139 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:21:04.348291 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345142 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345144 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345147 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345151 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345153 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345157 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345159 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345162 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345164 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345167 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345170 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345172 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345175 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345178 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345180 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345182 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345186 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345188 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345191 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345193 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:21:04.348777 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345196 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345198 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345201 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345204 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345207 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345209 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345212 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345215 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345217 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345220 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345222 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345225 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345228 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345230 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345233 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345235 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345238 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345241 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345245 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345248 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:21:04.349275 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345251 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345254 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345256 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345259 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345261 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345264 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345267 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345269 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345272 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345274 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345277 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345280 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345282 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345285 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345288 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345300 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345303 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345306 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345309 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:21:04.349755 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345311 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345314 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345317 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345319 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345322 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345325 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345328 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345330 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345333 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345335 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345339 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345342 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345346 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345349 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345353 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:21:04.350233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345358 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.345363 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345471 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345477 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345480 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345483 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345486 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345489 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345492 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345494 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345497 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345501 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345505 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345508 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345517 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:21:04.350602 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345520 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345523 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345526 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345528 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345531 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345534 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345536 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345539 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345541 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345544 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345547 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345550 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345553 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345555 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345558 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345561 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345563 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345566 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345569 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:21:04.350970 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345571 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345575 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345579 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345582 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345585 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345587 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345590 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345592 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345595 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345598 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345600 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345603 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345605 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345609 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345612 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345615 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345617 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345622 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345625 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:21:04.351444 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345628 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345631 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345634 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345637 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345640 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345643 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345646 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345648 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345651 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345654 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345657 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345659 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345662 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345665 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345667 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345670 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345673 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345675 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345678 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345680 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:21:04.351912 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345683 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345686 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345688 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345691 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345693 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345696 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345699 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345702 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345705 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345708 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345711 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345714 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345716 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345719 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345722 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345724 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345727 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345730 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345732 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345735 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:21:04.352404 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345738 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345741 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345744 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345746 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345749 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345752 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345754 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:04.345757 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.345762 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.345877 2562 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.348945 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.349674 2562 server.go:1019] "Starting client certificate rotation" Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.349770 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 04:21:04.352893 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.349801 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 04:21:04.353244 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.351955 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 04:21:04.353732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.353699 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 04:21:04.360414 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.360396 2562 log.go:25] "Validated CRI v1 runtime API" Sep 18 04:21:04.363847 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.363832 2562 log.go:25] "Validated CRI v1 image API" Sep 18 04:21:04.364686 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.364667 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 04:21:04.368765 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.368746 2562 fs.go:135] Filesystem UUIDs: map[05a64818-f843-4740-b39c-13012806781d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d0901363-6d6a-4a0b-825f-4bb2aa0b3718:/dev/nvme0n1p3] Sep 18 04:21:04.368829 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.368764 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 04:21:04.373976 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.373874 2562 manager.go:216] Machine: {Timestamp:2026-09-18 04:21:04.373419056 +0000 UTC m=+1.892090458 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3169008 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24463367556b60761b7bbbae12ace7 SystemUUID:ec244633-6755-6b60-761b-7bbbae12ace7 BootID:401b012f-7122-4b71-819b-f41d648b2b58 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c8:8e:31:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c8:8e:31:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:aa:3e:54:07:b5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 04:21:04.373976 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.373972 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 04:21:04.374103 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.374090 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 04:21:04.375449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.375423 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 04:21:04.375577 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.375453 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-31.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 04:21:04.376461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.376451 2562 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 04:21:04.376494 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.376463 2562 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 04:21:04.376494 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.376471 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 04:21:04.376494 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.376481 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 04:21:04.377647 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.377634 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 04:21:04.381190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.381179 2562 state_mem.go:36] "Initialized new in-memory state store" Sep 18 04:21:04.381313 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.381304 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 04:21:04.381349 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.381338 2562 kubelet.go:486] "Attempting to sync node with API server" Sep 18 04:21:04.381377 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.381351 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 04:21:04.381377 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.381369 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 04:21:04.381434 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.381383 2562 kubelet.go:398] "Adding apiserver pod source" Sep 18 04:21:04.381434 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.381394 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 04:21:04.381847 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.381821 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 04:21:04.381847 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.381851 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 04:21:04.384680 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.384655 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 04:21:04.387812 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.387792 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 04:21:04.387889 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.387840 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 04:21:04.388938 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.388927 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 04:21:04.388990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.388944 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 04:21:04.388990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.388950 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 04:21:04.388990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.388955 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 04:21:04.388990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.388963 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 04:21:04.388990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.388969 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 04:21:04.388990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.388982 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 04:21:04.388990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.388987 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 04:21:04.388990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.388993 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 04:21:04.389217 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.388999 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 04:21:04.389217 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.389007 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 04:21:04.389217 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.389012 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 04:21:04.389217 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.389050 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 04:21:04.389217 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.389056 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 04:21:04.392758 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.392741 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 04:21:04.392827 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.392819 2562 server.go:1268] "Started kubelet" Sep 18 04:21:04.392885 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.392850 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 04:21:04.392944 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.392889 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 04:21:04.392990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.392959 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 04:21:04.393611 ip-10-0-132-31 systemd[1]: Started Kubernetes Kubelet. Sep 18 04:21:04.394099 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.394083 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 04:21:04.394713 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.394557 2562 server.go:310] "Adding debug handlers to kubelet server" Sep 18 04:21:04.396447 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.396428 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-31.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 04:21:04.396558 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.396540 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 04:21:04.396614 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.396581 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 04:21:04.398863 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.398844 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 04:21:04.400262 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.400246 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 04:21:04.400335 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.400262 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 04:21:04.400335 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.400319 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:04.400802 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.400736 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 04:21:04.400802 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.400747 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 04:21:04.400802 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.400788 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 04:21:04.401149 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.400945 2562 reconstruct.go:97] "Volume reconstruction finished" Sep 18 04:21:04.401149 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.400955 2562 reconciler.go:29] "Reconciler: start to sync state" Sep 18 04:21:04.401149 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.401126 2562 factory.go:55] Registering systemd factory Sep 18 04:21:04.401149 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.401138 2562 factory.go:223] Registration of the systemd container factory successfully Sep 18 04:21:04.401376 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.401361 2562 factory.go:153] Registering CRI-O factory Sep 18 04:21:04.401428 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.401379 2562 factory.go:223] Registration of the crio container factory successfully Sep 18 04:21:04.401477 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.401429 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 04:21:04.401477 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.401448 2562 factory.go:103] Registering Raw factory Sep 18 04:21:04.401477 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.401462 2562 manager.go:1196] Started watching for new ooms in manager Sep 18 04:21:04.401866 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.401843 2562 manager.go:349] Starting recovery of all containers Sep 18 04:21:04.402940 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.402917 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 04:21:04.403083 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.403068 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 04:21:04.426829 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.426803 2562 manager.go:354] Recovery completed Sep 18 04:21:04.428693 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.428656 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jdd26" Sep 18 04:21:04.428811 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.428799 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jdd26" Sep 18 04:21:04.433113 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.433096 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:21:04.434950 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.434931 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:21:04.435015 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.434959 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:21:04.435015 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.434969 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:21:04.435575 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.435560 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 04:21:04.435575 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.435573 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 04:21:04.435681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.435588 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:21:04.435681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.435591 2562 state_mem.go:36] "Initialized new in-memory state store" Sep 18 04:21:04.436268 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.436251 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:21:04.436338 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.436282 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:21:04.436338 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.436300 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:21:04.437640 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.437627 2562 policy_none.go:49] "None policy: Start" Sep 18 04:21:04.437678 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.437644 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 04:21:04.437678 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.437654 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 04:21:04.439641 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.439628 2562 policy_none.go:47] "Start" Sep 18 04:21:04.484609 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.484592 2562 manager.go:337] "Starting Device Plugin manager" Sep 18 04:21:04.494505 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.484627 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 04:21:04.494505 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.484637 2562 server.go:87] "Starting device plugin registration server" Sep 18 04:21:04.494505 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.484864 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 04:21:04.494505 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.484889 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 04:21:04.494505 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.484982 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 04:21:04.494505 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.485427 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 04:21:04.494505 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.485441 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 04:21:04.494505 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.485550 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 04:21:04.494505 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.485594 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:04.549262 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.549226 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 04:21:04.550422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.550398 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 04:21:04.550520 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.550449 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 04:21:04.550520 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.550470 2562 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 04:21:04.550520 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.550508 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 04:21:04.552830 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.552813 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:21:04.585539 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.585473 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:21:04.586448 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.586434 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:21:04.586498 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.586466 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:21:04.586498 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.586477 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:21:04.586498 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.586498 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.598604 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.598589 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.598648 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.598607 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-31.ec2.internal\": node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:04.620766 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.620748 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:04.650966 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.650934 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal"] Sep 18 04:21:04.651042 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.651013 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:21:04.651765 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.651750 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:21:04.651828 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.651780 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:21:04.651828 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.651790 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:21:04.654130 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.654119 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:21:04.654259 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.654246 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.654298 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.654274 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:21:04.654837 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.654821 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:21:04.654901 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.654850 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:21:04.654901 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.654821 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:21:04.654901 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.654865 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:21:04.654901 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.654879 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:21:04.655022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.654904 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:21:04.657163 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.657150 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.657216 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.657172 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:21:04.657824 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.657810 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:21:04.657881 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.657840 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:21:04.657881 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.657857 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:21:04.692600 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.692581 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-31.ec2.internal\" not found" node="ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.696867 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.696852 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-31.ec2.internal\" not found" node="ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.702050 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.702019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec59397d24be7c17c0eb40bf4d4022d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal\" (UID: \"ec59397d24be7c17c0eb40bf4d4022d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.702123 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.702061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec59397d24be7c17c0eb40bf4d4022d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal\" (UID: \"ec59397d24be7c17c0eb40bf4d4022d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.702123 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.702095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/769d9c0849764b6dde0e88ec04de02c0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-31.ec2.internal\" (UID: \"769d9c0849764b6dde0e88ec04de02c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.721080 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.721060 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:04.802474 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.802451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/769d9c0849764b6dde0e88ec04de02c0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-31.ec2.internal\" (UID: \"769d9c0849764b6dde0e88ec04de02c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.802562 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.802481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec59397d24be7c17c0eb40bf4d4022d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal\" (UID: \"ec59397d24be7c17c0eb40bf4d4022d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.802562 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.802500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec59397d24be7c17c0eb40bf4d4022d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal\" (UID: \"ec59397d24be7c17c0eb40bf4d4022d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.802562 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.802524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec59397d24be7c17c0eb40bf4d4022d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal\" (UID: \"ec59397d24be7c17c0eb40bf4d4022d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.802562 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.802536 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/769d9c0849764b6dde0e88ec04de02c0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-31.ec2.internal\" (UID: \"769d9c0849764b6dde0e88ec04de02c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.802562 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.802558 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec59397d24be7c17c0eb40bf4d4022d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal\" (UID: \"ec59397d24be7c17c0eb40bf4d4022d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.821351 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.821333 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:04.921813 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:04.921748 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:04.996054 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.996005 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" Sep 18 04:21:04.999737 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:04.999721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal" Sep 18 04:21:05.022697 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:05.022553 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:05.123124 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:05.123086 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:05.223572 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:05.223501 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:05.324096 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:05.324066 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:05.350239 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.350211 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 04:21:05.350636 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.350348 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 04:21:05.424786 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:05.424763 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:05.431568 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.431553 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:21:05.434596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.434568 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 04:16:04 +0000 UTC" deadline="2028-04-29 12:12:07.094669997 +0000 UTC" Sep 18 04:21:05.434596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.434592 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14143h51m1.66008065s" Sep 18 04:21:05.525450 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:05.525376 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:05.601824 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:05.601784 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769d9c0849764b6dde0e88ec04de02c0.slice/crio-098314c3a5a991df63082db3b44b976b2381b03c04ac866efa6043b7e3e04938 WatchSource:0}: Error finding container 098314c3a5a991df63082db3b44b976b2381b03c04ac866efa6043b7e3e04938: Status 404 returned error can't find the container with id 098314c3a5a991df63082db3b44b976b2381b03c04ac866efa6043b7e3e04938 Sep 18 04:21:05.602088 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:05.602070 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec59397d24be7c17c0eb40bf4d4022d3.slice/crio-88409818381b5f0693f58915dc6478e5922379c893a0d3c9a563b90d2254741b WatchSource:0}: Error finding container 88409818381b5f0693f58915dc6478e5922379c893a0d3c9a563b90d2254741b: Status 404 returned error can't find the container with id 88409818381b5f0693f58915dc6478e5922379c893a0d3c9a563b90d2254741b Sep 18 04:21:05.606833 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.606814 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 04:21:05.625480 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:05.625460 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-31.ec2.internal\" not found" Sep 18 04:21:05.681854 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.681838 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:21:05.700970 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.700940 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" Sep 18 04:21:05.723879 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.723862 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 04:21:05.725493 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.725482 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal" Sep 18 04:21:05.746649 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.746631 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 04:21:05.907823 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:05.907754 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:21:06.383614 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.383532 2562 apiserver.go:52] "Watching apiserver" Sep 18 04:21:06.391216 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.390903 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 04:21:06.391769 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.391733 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-rcsd4","kube-system/konnectivity-agent-rhb9v","kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal","openshift-multus/multus-additional-cni-plugins-zxkjc","openshift-network-operator/iptables-alerter-tpsd2","openshift-ovn-kubernetes/ovnkube-node-mxvht","kube-system/global-pull-secret-syncer-4fncm","openshift-cluster-node-tuning-operator/tuned-vcktx","openshift-dns/node-resolver-cpcdt","openshift-image-registry/node-ca-krsb8","openshift-multus/multus-5x27n","openshift-multus/network-metrics-daemon-fn5bz"] Sep 18 04:21:06.394653 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.394629 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.396911 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.396857 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.399015 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.398674 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2bb5t\"" Sep 18 04:21:06.399015 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.398831 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 04:21:06.399015 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.398928 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 04:21:06.399233 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.399071 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 04:21:06.399389 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.399367 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:06.399483 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.399460 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:06.400341 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.399879 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 04:21:06.400341 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.400125 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vpzp2\"" Sep 18 04:21:06.400341 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.400171 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 04:21:06.401671 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.400898 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 04:21:06.401671 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.401339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.403893 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.403876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.404813 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.404791 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 04:21:06.404908 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.404801 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 04:21:06.404908 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.404855 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vvj4h\"" Sep 18 04:21:06.404908 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.404863 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 04:21:06.406350 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.406326 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.406864 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.406690 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 04:21:06.409352 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.408837 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 04:21:06.409352 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.409081 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 04:21:06.409352 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.409178 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zd2bb\"" Sep 18 04:21:06.409352 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.409308 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 04:21:06.409352 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.409088 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 04:21:06.409646 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.409461 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 04:21:06.409646 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.409587 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:06.409752 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.409642 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:06.409752 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.409660 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5bgzx\"" Sep 18 04:21:06.409843 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.409769 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 04:21:06.409927 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.409903 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 04:21:06.411561 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.411543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.411749 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.411734 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412017 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-device-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f39bd3-36aa-4c9b-b362-e58a3ba27a05-host-slash\") pod \"iptables-alerter-tpsd2\" (UID: \"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05\") " pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-etc-selinux\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-sys-fs\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvl98\" (UniqueName: \"kubernetes.io/projected/a1f39bd3-36aa-4c9b-b362-e58a3ba27a05-kube-api-access-kvl98\") pod \"iptables-alerter-tpsd2\" (UID: \"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05\") " pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0226753d-8c5a-48b5-9c7b-583e15617548-tmp-dir\") pod \"node-resolver-cpcdt\" (UID: \"0226753d-8c5a-48b5-9c7b-583e15617548\") " pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvhtn\" (UniqueName: \"kubernetes.io/projected/03823fc1-c5c8-471d-825a-256e029b9bce-kube-api-access-qvhtn\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8gjw\" (UniqueName: \"kubernetes.io/projected/99799489-168c-4a1a-a647-1012c3958779-kube-api-access-j8gjw\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-socket-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-registration-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1f39bd3-36aa-4c9b-b362-e58a3ba27a05-iptables-alerter-script\") pod \"iptables-alerter-tpsd2\" (UID: \"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05\") " pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0226753d-8c5a-48b5-9c7b-583e15617548-hosts-file\") pod \"node-resolver-cpcdt\" (UID: \"0226753d-8c5a-48b5-9c7b-583e15617548\") " pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.412457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.412410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd5wn\" (UniqueName: \"kubernetes.io/projected/0226753d-8c5a-48b5-9c7b-583e15617548-kube-api-access-sd5wn\") pod \"node-resolver-cpcdt\" (UID: \"0226753d-8c5a-48b5-9c7b-583e15617548\") " pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.414221 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.413796 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 04:21:06.414221 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.413996 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 04:21:06.414221 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.414098 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7v7tg\"" Sep 18 04:21:06.414221 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.414184 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:06.416465 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.416448 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.417276 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.417256 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 04:21:06.417518 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.417499 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mrtbn\"" Sep 18 04:21:06.417712 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.417694 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 04:21:06.419246 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.418677 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 04:21:06.419246 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.418689 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 04:21:06.419246 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.418912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:06.419246 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.418982 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:06.419620 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.419598 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m9498\"" Sep 18 04:21:06.420914 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.420898 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 04:21:06.421267 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.421249 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.423613 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.423597 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-62t68\"" Sep 18 04:21:06.423730 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.423700 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 04:21:06.424215 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.424186 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 04:21:06.424371 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.424353 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 04:21:06.450807 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.450780 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pt5hc" Sep 18 04:21:06.461549 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.461525 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pt5hc" Sep 18 04:21:06.501975 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.501947 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd5wn\" (UniqueName: \"kubernetes.io/projected/0226753d-8c5a-48b5-9c7b-583e15617548-kube-api-access-sd5wn\") pod \"node-resolver-cpcdt\" (UID: \"0226753d-8c5a-48b5-9c7b-583e15617548\") " pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6m5m\" (UniqueName: \"kubernetes.io/projected/d7a3defb-be96-4c25-80b8-72fbb9998a24-kube-api-access-t6m5m\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-modprobe-d\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c47c4573-b277-4a8a-8aee-d5b81b9275dd-env-overrides\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-sysctl-conf\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56f68\" (UniqueName: \"kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68\") pod \"network-check-target-rcsd4\" (UID: \"b9773745-b436-43ba-88b7-24316c1c1385\") " pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0226753d-8c5a-48b5-9c7b-583e15617548-tmp-dir\") pod \"node-resolver-cpcdt\" (UID: \"0226753d-8c5a-48b5-9c7b-583e15617548\") " pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-run-netns\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-log-socket\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1abb6f25-c656-4523-a5f7-d347cc63b7e2-cnibin\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-cni-dir\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-var-lib-kubelet\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-run\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513400 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-var-lib-kubelet\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513425 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c7da603-41c7-4ead-adda-af15986dda34-etc-tuned\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.515585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-registration-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-kubelet\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513498 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-run-ovn\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-cni-bin\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513544 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-cnibin\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-var-lib-cni-bin\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513590 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-conf-dir\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513612 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/353a5565-874a-4a0e-b82d-986e698a2a36-host\") pod \"node-ca-krsb8\" (UID: \"353a5565-874a-4a0e-b82d-986e698a2a36\") " pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513660 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-run-openvswitch\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c47c4573-b277-4a8a-8aee-d5b81b9275dd-ovnkube-config\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1abb6f25-c656-4523-a5f7-d347cc63b7e2-system-cni-dir\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513732 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-systemd\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-sys\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c7da603-41c7-4ead-adda-af15986dda34-tmp\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-node-log\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.516681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-system-cni-dir\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5810a0f6-ab3e-4945-8090-c6623fc2c473-agent-certs\") pod \"konnectivity-agent-rhb9v\" (UID: \"5810a0f6-ab3e-4945-8090-c6623fc2c473\") " pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-lib-modules\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-host\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/353a5565-874a-4a0e-b82d-986e698a2a36-serviceca\") pod \"node-ca-krsb8\" (UID: \"353a5565-874a-4a0e-b82d-986e698a2a36\") " pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.513986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8gjw\" (UniqueName: \"kubernetes.io/projected/99799489-168c-4a1a-a647-1012c3958779-kube-api-access-j8gjw\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-systemd-units\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514075 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-run-k8s-cni-cncf-io\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c47c4573-b277-4a8a-8aee-d5b81b9275dd-ovn-node-metrics-cert\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a3defb-be96-4c25-80b8-72fbb9998a24-cni-binary-copy\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-socket-dir-parent\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-kubernetes\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514206 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-sysctl-d\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-device-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-var-lib-openvswitch\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.517594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-cni-netd\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514315 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1abb6f25-c656-4523-a5f7-d347cc63b7e2-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9gkv\" (UniqueName: \"kubernetes.io/projected/1abb6f25-c656-4523-a5f7-d347cc63b7e2-kube-api-access-j9gkv\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-run-netns\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmxwl\" (UniqueName: \"kubernetes.io/projected/353a5565-874a-4a0e-b82d-986e698a2a36-kube-api-access-xmxwl\") pod \"node-ca-krsb8\" (UID: \"353a5565-874a-4a0e-b82d-986e698a2a36\") " pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvl98\" (UniqueName: \"kubernetes.io/projected/a1f39bd3-36aa-4c9b-b362-e58a3ba27a05-kube-api-access-kvl98\") pod \"iptables-alerter-tpsd2\" (UID: \"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05\") " pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvhtn\" (UniqueName: \"kubernetes.io/projected/03823fc1-c5c8-471d-825a-256e029b9bce-kube-api-access-qvhtn\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-slash\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514507 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-run-systemd\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c47c4573-b277-4a8a-8aee-d5b81b9275dd-ovnkube-script-lib\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514540 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-kubelet-config\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1abb6f25-c656-4523-a5f7-d347cc63b7e2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5810a0f6-ab3e-4945-8090-c6623fc2c473-konnectivity-ca\") pod \"konnectivity-agent-rhb9v\" (UID: \"5810a0f6-ab3e-4945-8090-c6623fc2c473\") " pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-sysconfig\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-socket-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1f39bd3-36aa-4c9b-b362-e58a3ba27a05-iptables-alerter-script\") pod \"iptables-alerter-tpsd2\" (UID: \"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05\") " pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.518353 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0226753d-8c5a-48b5-9c7b-583e15617548-hosts-file\") pod \"node-resolver-cpcdt\" (UID: \"0226753d-8c5a-48b5-9c7b-583e15617548\") " pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-etc-openvswitch\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514778 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1abb6f25-c656-4523-a5f7-d347cc63b7e2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1abb6f25-c656-4523-a5f7-d347cc63b7e2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.514906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-var-lib-cni-multus\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515209 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-device-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515280 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-registration-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515287 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0226753d-8c5a-48b5-9c7b-583e15617548-tmp-dir\") pod \"node-resolver-cpcdt\" (UID: \"0226753d-8c5a-48b5-9c7b-583e15617548\") " pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.515351 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515357 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.515412 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs podName:03823fc1-c5c8-471d-825a-256e029b9bce nodeName:}" failed. No retries permitted until 2026-09-18 04:21:07.015390366 +0000 UTC m=+4.534061745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs") pod "network-metrics-daemon-fn5bz" (UID: "03823fc1-c5c8-471d-825a-256e029b9bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515488 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-socket-dir\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515540 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0226753d-8c5a-48b5-9c7b-583e15617548-hosts-file\") pod \"node-resolver-cpcdt\" (UID: \"0226753d-8c5a-48b5-9c7b-583e15617548\") " pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f39bd3-36aa-4c9b-b362-e58a3ba27a05-host-slash\") pod \"iptables-alerter-tpsd2\" (UID: \"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05\") " pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4xdk\" (UniqueName: \"kubernetes.io/projected/c47c4573-b277-4a8a-8aee-d5b81b9275dd-kube-api-access-c4xdk\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.519043 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-hostroot\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-daemon-config\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-run-multus-certs\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pq99\" (UniqueName: \"kubernetes.io/projected/7c7da603-41c7-4ead-adda-af15986dda34-kube-api-access-4pq99\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515804 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f39bd3-36aa-4c9b-b362-e58a3ba27a05-host-slash\") pod \"iptables-alerter-tpsd2\" (UID: \"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05\") " pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515849 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-etc-selinux\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515873 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-sys-fs\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-etc-kubernetes\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-dbus\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.515978 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-sys-fs\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.516001 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1f39bd3-36aa-4c9b-b362-e58a3ba27a05-iptables-alerter-script\") pod \"iptables-alerter-tpsd2\" (UID: \"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05\") " pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.519800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.516044 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99799489-168c-4a1a-a647-1012c3958779-etc-selinux\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.521638 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.521610 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 04:21:06.525681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.525561 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvl98\" (UniqueName: \"kubernetes.io/projected/a1f39bd3-36aa-4c9b-b362-e58a3ba27a05-kube-api-access-kvl98\") pod \"iptables-alerter-tpsd2\" (UID: \"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05\") " pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.525681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.525604 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd5wn\" (UniqueName: \"kubernetes.io/projected/0226753d-8c5a-48b5-9c7b-583e15617548-kube-api-access-sd5wn\") pod \"node-resolver-cpcdt\" (UID: \"0226753d-8c5a-48b5-9c7b-583e15617548\") " pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.527703 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.527680 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8gjw\" (UniqueName: \"kubernetes.io/projected/99799489-168c-4a1a-a647-1012c3958779-kube-api-access-j8gjw\") pod \"aws-ebs-csi-driver-node-wq47p\" (UID: \"99799489-168c-4a1a-a647-1012c3958779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.533294 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.533271 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvhtn\" (UniqueName: \"kubernetes.io/projected/03823fc1-c5c8-471d-825a-256e029b9bce-kube-api-access-qvhtn\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:06.557884 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.557823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" event={"ID":"ec59397d24be7c17c0eb40bf4d4022d3","Type":"ContainerStarted","Data":"88409818381b5f0693f58915dc6478e5922379c893a0d3c9a563b90d2254741b"} Sep 18 04:21:06.559179 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.559149 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal" event={"ID":"769d9c0849764b6dde0e88ec04de02c0","Type":"ContainerStarted","Data":"098314c3a5a991df63082db3b44b976b2381b03c04ac866efa6043b7e3e04938"} Sep 18 04:21:06.617181 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-systemd-units\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.617181 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.617407 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-run-k8s-cni-cncf-io\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.617407 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c47c4573-b277-4a8a-8aee-d5b81b9275dd-ovn-node-metrics-cert\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.617407 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a3defb-be96-4c25-80b8-72fbb9998a24-cni-binary-copy\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.617407 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-socket-dir-parent\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.617407 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617289 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-systemd-units\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.617407 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-kubernetes\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.617407 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617303 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.617407 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617344 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-sysctl-d\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.617407 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-var-lib-openvswitch\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.617407 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-cni-netd\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1abb6f25-c656-4523-a5f7-d347cc63b7e2-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617425 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-kubernetes\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9gkv\" (UniqueName: \"kubernetes.io/projected/1abb6f25-c656-4523-a5f7-d347cc63b7e2-kube-api-access-j9gkv\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-run-netns\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmxwl\" (UniqueName: \"kubernetes.io/projected/353a5565-874a-4a0e-b82d-986e698a2a36-kube-api-access-xmxwl\") pod \"node-ca-krsb8\" (UID: \"353a5565-874a-4a0e-b82d-986e698a2a36\") " pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-slash\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-run-systemd\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617540 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-socket-dir-parent\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c47c4573-b277-4a8a-8aee-d5b81b9275dd-ovnkube-script-lib\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-kubelet-config\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1abb6f25-c656-4523-a5f7-d347cc63b7e2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5810a0f6-ab3e-4945-8090-c6623fc2c473-konnectivity-ca\") pod \"konnectivity-agent-rhb9v\" (UID: \"5810a0f6-ab3e-4945-8090-c6623fc2c473\") " pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617635 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-run-k8s-cni-cncf-io\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-sysconfig\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617676 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-run-netns\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617684 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-sysconfig\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.617906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-etc-openvswitch\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617762 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-kubelet-config\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1abb6f25-c656-4523-a5f7-d347cc63b7e2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617797 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-cni-netd\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617797 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1abb6f25-c656-4523-a5f7-d347cc63b7e2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617808 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-run-systemd\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-var-lib-cni-multus\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617861 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-var-lib-openvswitch\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4xdk\" (UniqueName: \"kubernetes.io/projected/c47c4573-b277-4a8a-8aee-d5b81b9275dd-kube-api-access-c4xdk\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-hostroot\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617900 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-slash\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-daemon-config\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617942 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-run-multus-certs\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pq99\" (UniqueName: \"kubernetes.io/projected/7c7da603-41c7-4ead-adda-af15986dda34-kube-api-access-4pq99\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-etc-kubernetes\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.618705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-dbus\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6m5m\" (UniqueName: \"kubernetes.io/projected/d7a3defb-be96-4c25-80b8-72fbb9998a24-kube-api-access-t6m5m\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-modprobe-d\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c47c4573-b277-4a8a-8aee-d5b81b9275dd-env-overrides\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-sysctl-conf\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56f68\" (UniqueName: \"kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68\") pod \"network-check-target-rcsd4\" (UID: \"b9773745-b436-43ba-88b7-24316c1c1385\") " pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-run-netns\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-log-socket\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1abb6f25-c656-4523-a5f7-d347cc63b7e2-cnibin\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-cni-dir\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618301 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1abb6f25-c656-4523-a5f7-d347cc63b7e2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-var-lib-kubelet\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-run\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.617985 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-run-multus-certs\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618381 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c47c4573-b277-4a8a-8aee-d5b81b9275dd-ovnkube-script-lib\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-sysctl-d\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.619461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618527 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1abb6f25-c656-4523-a5f7-d347cc63b7e2-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618540 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1abb6f25-c656-4523-a5f7-d347cc63b7e2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618620 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-etc-openvswitch\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618622 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-etc-kubernetes\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618740 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-dbus\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618743 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-hostroot\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618765 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-var-lib-cni-multus\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618767 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a3defb-be96-4c25-80b8-72fbb9998a24-cni-binary-copy\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618803 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-cni-dir\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618805 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-log-socket\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.618822 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618832 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-var-lib-kubelet\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.618862 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret podName:e3fd06a6-c6b4-4f66-9f86-d9857a390bd1 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:07.118850591 +0000 UTC m=+4.637521960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret") pod "global-pull-secret-syncer-4fncm" (UID: "e3fd06a6-c6b4-4f66-9f86-d9857a390bd1") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-var-lib-kubelet\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c7da603-41c7-4ead-adda-af15986dda34-etc-tuned\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.618984 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c47c4573-b277-4a8a-8aee-d5b81b9275dd-env-overrides\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619047 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-modprobe-d\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619053 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-run\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.620329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619104 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-run-netns\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619146 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-var-lib-kubelet\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-kubelet\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619191 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1abb6f25-c656-4523-a5f7-d347cc63b7e2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619224 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1abb6f25-c656-4523-a5f7-d347cc63b7e2-cnibin\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619238 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-kubelet\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-run-ovn\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619301 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-daemon-config\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-cni-bin\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-cnibin\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619354 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5810a0f6-ab3e-4945-8090-c6623fc2c473-konnectivity-ca\") pod \"konnectivity-agent-rhb9v\" (UID: \"5810a0f6-ab3e-4945-8090-c6623fc2c473\") " pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619361 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-sysctl-conf\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619393 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-cnibin\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619413 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-run-ovn\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619441 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-host-cni-bin\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-var-lib-cni-bin\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-conf-dir\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/353a5565-874a-4a0e-b82d-986e698a2a36-host\") pod \"node-ca-krsb8\" (UID: \"353a5565-874a-4a0e-b82d-986e698a2a36\") " pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.621190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-run-openvswitch\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619559 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/353a5565-874a-4a0e-b82d-986e698a2a36-host\") pod \"node-ca-krsb8\" (UID: \"353a5565-874a-4a0e-b82d-986e698a2a36\") " pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619559 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-multus-conf-dir\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c47c4573-b277-4a8a-8aee-d5b81b9275dd-ovnkube-config\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619599 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-run-openvswitch\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619605 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-host-var-lib-cni-bin\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1abb6f25-c656-4523-a5f7-d347cc63b7e2-system-cni-dir\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619631 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1abb6f25-c656-4523-a5f7-d347cc63b7e2-system-cni-dir\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-systemd\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619680 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-sys\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c7da603-41c7-4ead-adda-af15986dda34-tmp\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619712 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-etc-systemd\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-node-log\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-system-cni-dir\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619785 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-sys\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5810a0f6-ab3e-4945-8090-c6623fc2c473-agent-certs\") pod \"konnectivity-agent-rhb9v\" (UID: \"5810a0f6-ab3e-4945-8090-c6623fc2c473\") " pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-lib-modules\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-host\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.622022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/353a5565-874a-4a0e-b82d-986e698a2a36-serviceca\") pod \"node-ca-krsb8\" (UID: \"353a5565-874a-4a0e-b82d-986e698a2a36\") " pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.622645 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.619956 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-lib-modules\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.622645 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.620007 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c47c4573-b277-4a8a-8aee-d5b81b9275dd-node-log\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.622645 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.620023 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c7da603-41c7-4ead-adda-af15986dda34-host\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.622645 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.620059 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c47c4573-b277-4a8a-8aee-d5b81b9275dd-ovnkube-config\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.622645 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.620076 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3defb-be96-4c25-80b8-72fbb9998a24-system-cni-dir\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.622645 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.620291 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/353a5565-874a-4a0e-b82d-986e698a2a36-serviceca\") pod \"node-ca-krsb8\" (UID: \"353a5565-874a-4a0e-b82d-986e698a2a36\") " pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.622645 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.621707 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c7da603-41c7-4ead-adda-af15986dda34-etc-tuned\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.622645 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.622072 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5810a0f6-ab3e-4945-8090-c6623fc2c473-agent-certs\") pod \"konnectivity-agent-rhb9v\" (UID: \"5810a0f6-ab3e-4945-8090-c6623fc2c473\") " pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:06.622645 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.622421 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c47c4573-b277-4a8a-8aee-d5b81b9275dd-ovn-node-metrics-cert\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.623119 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.622950 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c7da603-41c7-4ead-adda-af15986dda34-tmp\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.634386 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.634339 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmxwl\" (UniqueName: \"kubernetes.io/projected/353a5565-874a-4a0e-b82d-986e698a2a36-kube-api-access-xmxwl\") pod \"node-ca-krsb8\" (UID: \"353a5565-874a-4a0e-b82d-986e698a2a36\") " pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.635340 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.635240 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:21:06.635340 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.635263 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:21:06.635340 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.635276 2562 projected.go:196] Error preparing data for projected volume kube-api-access-56f68 for pod openshift-network-diagnostics/network-check-target-rcsd4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:06.635526 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:06.635349 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68 podName:b9773745-b436-43ba-88b7-24316c1c1385 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:07.135333012 +0000 UTC m=+4.654004385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-56f68" (UniqueName: "kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68") pod "network-check-target-rcsd4" (UID: "b9773745-b436-43ba-88b7-24316c1c1385") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:06.637271 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.637249 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pq99\" (UniqueName: \"kubernetes.io/projected/7c7da603-41c7-4ead-adda-af15986dda34-kube-api-access-4pq99\") pod \"tuned-vcktx\" (UID: \"7c7da603-41c7-4ead-adda-af15986dda34\") " pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.639225 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.639189 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9gkv\" (UniqueName: \"kubernetes.io/projected/1abb6f25-c656-4523-a5f7-d347cc63b7e2-kube-api-access-j9gkv\") pod \"multus-additional-cni-plugins-zxkjc\" (UID: \"1abb6f25-c656-4523-a5f7-d347cc63b7e2\") " pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.639430 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.639413 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4xdk\" (UniqueName: \"kubernetes.io/projected/c47c4573-b277-4a8a-8aee-d5b81b9275dd-kube-api-access-c4xdk\") pod \"ovnkube-node-mxvht\" (UID: \"c47c4573-b277-4a8a-8aee-d5b81b9275dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.643280 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.643258 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6m5m\" (UniqueName: \"kubernetes.io/projected/d7a3defb-be96-4c25-80b8-72fbb9998a24-kube-api-access-t6m5m\") pod \"multus-5x27n\" (UID: \"d7a3defb-be96-4c25-80b8-72fbb9998a24\") " pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.708977 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.708953 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tpsd2" Sep 18 04:21:06.717634 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.717615 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cpcdt" Sep 18 04:21:06.735260 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.735242 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" Sep 18 04:21:06.742891 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.742870 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:06.749485 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.749466 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" Sep 18 04:21:06.757093 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.757072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5x27n" Sep 18 04:21:06.764620 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.764603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:06.772185 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.772166 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vcktx" Sep 18 04:21:06.778763 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.778744 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-krsb8" Sep 18 04:21:06.799561 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:06.799539 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:21:07.022164 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:07.022063 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:07.022313 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:07.022254 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:07.022374 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:07.022324 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs podName:03823fc1-c5c8-471d-825a-256e029b9bce nodeName:}" failed. No retries permitted until 2026-09-18 04:21:08.022303965 +0000 UTC m=+5.540975336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs") pod "network-metrics-daemon-fn5bz" (UID: "03823fc1-c5c8-471d-825a-256e029b9bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:07.123118 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:07.123077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:07.123297 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:07.123224 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:07.123297 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:07.123285 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret podName:e3fd06a6-c6b4-4f66-9f86-d9857a390bd1 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:08.123269691 +0000 UTC m=+5.641941081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret") pod "global-pull-secret-syncer-4fncm" (UID: "e3fd06a6-c6b4-4f66-9f86-d9857a390bd1") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:07.224303 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:07.224274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56f68\" (UniqueName: \"kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68\") pod \"network-check-target-rcsd4\" (UID: \"b9773745-b436-43ba-88b7-24316c1c1385\") " pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:07.224452 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:07.224434 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:21:07.224498 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:07.224458 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:21:07.224498 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:07.224467 2562 projected.go:196] Error preparing data for projected volume kube-api-access-56f68 for pod openshift-network-diagnostics/network-check-target-rcsd4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:07.224564 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:07.224522 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68 podName:b9773745-b436-43ba-88b7-24316c1c1385 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:08.224508706 +0000 UTC m=+5.743180080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-56f68" (UniqueName: "kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68") pod "network-check-target-rcsd4" (UID: "b9773745-b436-43ba-88b7-24316c1c1385") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:07.465055 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:07.464965 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 04:16:06 +0000 UTC" deadline="2028-06-21 17:31:17.115104808 +0000 UTC" Sep 18 04:21:07.465055 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:07.464994 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15421h10m9.65011576s" Sep 18 04:21:07.551277 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:07.551258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:07.551387 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:07.551288 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:07.551387 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:07.551373 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:07.551515 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:07.551494 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:07.564244 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:07.564162 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7da603_41c7_4ead_adda_af15986dda34.slice/crio-19fa780bc7922b91a9b8609e0ba7af31c5418295d2aa7e82de9972d7e78ca836 WatchSource:0}: Error finding container 19fa780bc7922b91a9b8609e0ba7af31c5418295d2aa7e82de9972d7e78ca836: Status 404 returned error can't find the container with id 19fa780bc7922b91a9b8609e0ba7af31c5418295d2aa7e82de9972d7e78ca836 Sep 18 04:21:07.565520 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:07.565500 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1abb6f25_c656_4523_a5f7_d347cc63b7e2.slice/crio-ec7f6e3b4fe0e9a5be16d8a65cd55991c8789df35dc2724a9a76dd1623684f1a WatchSource:0}: Error finding container ec7f6e3b4fe0e9a5be16d8a65cd55991c8789df35dc2724a9a76dd1623684f1a: Status 404 returned error can't find the container with id ec7f6e3b4fe0e9a5be16d8a65cd55991c8789df35dc2724a9a76dd1623684f1a Sep 18 04:21:07.568790 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:07.568769 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5810a0f6_ab3e_4945_8090_c6623fc2c473.slice/crio-01991f7958c6934d41609de58640bcc517fabd3e3cc55dcbe69780e913034d65 WatchSource:0}: Error finding container 01991f7958c6934d41609de58640bcc517fabd3e3cc55dcbe69780e913034d65: Status 404 returned error can't find the container with id 01991f7958c6934d41609de58640bcc517fabd3e3cc55dcbe69780e913034d65 Sep 18 04:21:07.570630 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:07.570600 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f39bd3_36aa_4c9b_b362_e58a3ba27a05.slice/crio-20e7323c29684c2fecde98ff1bed75852e6ee9c3c8a909585f8a03a84115ec8b WatchSource:0}: Error finding container 20e7323c29684c2fecde98ff1bed75852e6ee9c3c8a909585f8a03a84115ec8b: Status 404 returned error can't find the container with id 20e7323c29684c2fecde98ff1bed75852e6ee9c3c8a909585f8a03a84115ec8b Sep 18 04:21:07.572626 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:07.572603 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47c4573_b277_4a8a_8aee_d5b81b9275dd.slice/crio-509759c9d69239244e3c12022ef9f18c53cbc9ed2187136d5cd4bf83c9df25c5 WatchSource:0}: Error finding container 509759c9d69239244e3c12022ef9f18c53cbc9ed2187136d5cd4bf83c9df25c5: Status 404 returned error can't find the container with id 509759c9d69239244e3c12022ef9f18c53cbc9ed2187136d5cd4bf83c9df25c5 Sep 18 04:21:08.029973 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.029672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:08.030156 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:08.030142 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:08.030223 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:08.030217 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs podName:03823fc1-c5c8-471d-825a-256e029b9bce nodeName:}" failed. No retries permitted until 2026-09-18 04:21:10.030197227 +0000 UTC m=+7.548868611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs") pod "network-metrics-daemon-fn5bz" (UID: "03823fc1-c5c8-471d-825a-256e029b9bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:08.131283 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.131244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:08.131455 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:08.131410 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:08.131527 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:08.131473 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret podName:e3fd06a6-c6b4-4f66-9f86-d9857a390bd1 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:10.131455136 +0000 UTC m=+7.650126527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret") pod "global-pull-secret-syncer-4fncm" (UID: "e3fd06a6-c6b4-4f66-9f86-d9857a390bd1") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:08.231777 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.231642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56f68\" (UniqueName: \"kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68\") pod \"network-check-target-rcsd4\" (UID: \"b9773745-b436-43ba-88b7-24316c1c1385\") " pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:08.231941 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:08.231840 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:21:08.231941 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:08.231859 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:21:08.231941 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:08.231872 2562 projected.go:196] Error preparing data for projected volume kube-api-access-56f68 for pod openshift-network-diagnostics/network-check-target-rcsd4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:08.231941 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:08.231939 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68 podName:b9773745-b436-43ba-88b7-24316c1c1385 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:10.231919934 +0000 UTC m=+7.750591309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-56f68" (UniqueName: "kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68") pod "network-check-target-rcsd4" (UID: "b9773745-b436-43ba-88b7-24316c1c1385") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:08.465730 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.465611 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 04:16:06 +0000 UTC" deadline="2028-06-11 05:04:48.781581132 +0000 UTC" Sep 18 04:21:08.465730 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.465674 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15168h43m40.315911551s" Sep 18 04:21:08.552613 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.552582 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:08.552780 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:08.552717 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:08.577895 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.577859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-krsb8" event={"ID":"353a5565-874a-4a0e-b82d-986e698a2a36","Type":"ContainerStarted","Data":"da77e2ebf3d23e53898f2baca3258794db70234f793a7e8c2e54f63c36f11373"} Sep 18 04:21:08.587452 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.587381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tpsd2" event={"ID":"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05","Type":"ContainerStarted","Data":"20e7323c29684c2fecde98ff1bed75852e6ee9c3c8a909585f8a03a84115ec8b"} Sep 18 04:21:08.597153 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.597121 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5x27n" event={"ID":"d7a3defb-be96-4c25-80b8-72fbb9998a24","Type":"ContainerStarted","Data":"c6e0da2ddd5a2395b8ca422a31d6a50797b1b2f93a281d648bf9e9a932c3c04e"} Sep 18 04:21:08.613746 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.613713 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cpcdt" event={"ID":"0226753d-8c5a-48b5-9c7b-583e15617548","Type":"ContainerStarted","Data":"4acd34d5d70d7f4d80ebc57aa94ac3c6220ae6c5993e14a343a1aa0eced6828c"} Sep 18 04:21:08.622871 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.622839 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" event={"ID":"c47c4573-b277-4a8a-8aee-d5b81b9275dd","Type":"ContainerStarted","Data":"509759c9d69239244e3c12022ef9f18c53cbc9ed2187136d5cd4bf83c9df25c5"} Sep 18 04:21:08.629419 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.629382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rhb9v" event={"ID":"5810a0f6-ab3e-4945-8090-c6623fc2c473","Type":"ContainerStarted","Data":"01991f7958c6934d41609de58640bcc517fabd3e3cc55dcbe69780e913034d65"} Sep 18 04:21:08.642369 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.642337 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" event={"ID":"1abb6f25-c656-4523-a5f7-d347cc63b7e2","Type":"ContainerStarted","Data":"ec7f6e3b4fe0e9a5be16d8a65cd55991c8789df35dc2724a9a76dd1623684f1a"} Sep 18 04:21:08.645831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.645790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vcktx" event={"ID":"7c7da603-41c7-4ead-adda-af15986dda34","Type":"ContainerStarted","Data":"19fa780bc7922b91a9b8609e0ba7af31c5418295d2aa7e82de9972d7e78ca836"} Sep 18 04:21:08.650499 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.650470 2562 generic.go:356] "Generic (PLEG): container finished" podID="ec59397d24be7c17c0eb40bf4d4022d3" containerID="cbd42d5dbe5718ffeba4f3e6a4ca6f0894fcf39c20d65141a11da516a4f93a1a" exitCode=0 Sep 18 04:21:08.650598 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.650552 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" event={"ID":"ec59397d24be7c17c0eb40bf4d4022d3","Type":"ContainerDied","Data":"cbd42d5dbe5718ffeba4f3e6a4ca6f0894fcf39c20d65141a11da516a4f93a1a"} Sep 18 04:21:08.673770 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.673739 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal" event={"ID":"769d9c0849764b6dde0e88ec04de02c0","Type":"ContainerStarted","Data":"22ba9932371f89f539614cb293625488b1038d939ab0e9a8aeeffbe4cf1a5a97"} Sep 18 04:21:08.679681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:08.679652 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" event={"ID":"99799489-168c-4a1a-a647-1012c3958779","Type":"ContainerStarted","Data":"a19d94bbd3579656dd5de284a94007aff6b2804c19e68b751207c1b6d703c984"} Sep 18 04:21:09.550860 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:09.550810 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:09.551457 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:09.550943 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:09.551457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:09.551324 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:09.551457 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:09.551409 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:09.690481 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:09.690448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" event={"ID":"ec59397d24be7c17c0eb40bf4d4022d3","Type":"ContainerStarted","Data":"ad6fc2ddb8dab52d0e0eca7afac4c3734efce4196e9e8e7055a7b46188ea21cf"} Sep 18 04:21:09.707045 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:09.706970 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-31.ec2.internal" podStartSLOduration=4.706949195 podStartE2EDuration="4.706949195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:08.687199494 +0000 UTC m=+6.205870908" watchObservedRunningTime="2026-09-18 04:21:09.706949195 +0000 UTC m=+7.225620587" Sep 18 04:21:09.707238 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:09.707194 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-31.ec2.internal" podStartSLOduration=4.707183697 podStartE2EDuration="4.707183697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:09.706481076 +0000 UTC m=+7.225152554" watchObservedRunningTime="2026-09-18 04:21:09.707183697 +0000 UTC m=+7.225855089" Sep 18 04:21:10.052409 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:10.052355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:10.052583 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:10.052519 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:10.052643 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:10.052582 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs podName:03823fc1-c5c8-471d-825a-256e029b9bce nodeName:}" failed. No retries permitted until 2026-09-18 04:21:14.052565256 +0000 UTC m=+11.571236626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs") pod "network-metrics-daemon-fn5bz" (UID: "03823fc1-c5c8-471d-825a-256e029b9bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:10.153384 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:10.153346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:10.155277 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:10.155250 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:10.155417 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:10.155336 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret podName:e3fd06a6-c6b4-4f66-9f86-d9857a390bd1 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:14.155315875 +0000 UTC m=+11.673987264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret") pod "global-pull-secret-syncer-4fncm" (UID: "e3fd06a6-c6b4-4f66-9f86-d9857a390bd1") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:10.254004 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:10.253962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56f68\" (UniqueName: \"kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68\") pod \"network-check-target-rcsd4\" (UID: \"b9773745-b436-43ba-88b7-24316c1c1385\") " pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:10.254219 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:10.254199 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:21:10.254282 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:10.254219 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:21:10.254282 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:10.254233 2562 projected.go:196] Error preparing data for projected volume kube-api-access-56f68 for pod openshift-network-diagnostics/network-check-target-rcsd4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:10.254383 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:10.254294 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68 podName:b9773745-b436-43ba-88b7-24316c1c1385 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:14.254276147 +0000 UTC m=+11.772947521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-56f68" (UniqueName: "kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68") pod "network-check-target-rcsd4" (UID: "b9773745-b436-43ba-88b7-24316c1c1385") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:10.551515 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:10.551437 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:10.551957 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:10.551582 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:11.551354 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:11.551311 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:11.551515 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:11.551457 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:11.551515 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:11.551477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:11.551882 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:11.551590 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:12.551630 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:12.551357 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:12.551630 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:12.551493 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:13.551436 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:13.551407 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:13.551436 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:13.551442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:13.551700 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:13.551534 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:13.551700 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:13.551660 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:14.083050 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:14.083005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:14.083240 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:14.083221 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:14.083311 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:14.083283 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs podName:03823fc1-c5c8-471d-825a-256e029b9bce nodeName:}" failed. No retries permitted until 2026-09-18 04:21:22.083263072 +0000 UTC m=+19.601934440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs") pod "network-metrics-daemon-fn5bz" (UID: "03823fc1-c5c8-471d-825a-256e029b9bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:14.183383 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:14.183350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:14.183544 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:14.183524 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:14.183612 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:14.183594 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret podName:e3fd06a6-c6b4-4f66-9f86-d9857a390bd1 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:22.183572529 +0000 UTC m=+19.702243900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret") pod "global-pull-secret-syncer-4fncm" (UID: "e3fd06a6-c6b4-4f66-9f86-d9857a390bd1") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:14.284574 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:14.284523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56f68\" (UniqueName: \"kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68\") pod \"network-check-target-rcsd4\" (UID: \"b9773745-b436-43ba-88b7-24316c1c1385\") " pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:14.284771 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:14.284720 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:21:14.284771 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:14.284747 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:21:14.284771 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:14.284760 2562 projected.go:196] Error preparing data for projected volume kube-api-access-56f68 for pod openshift-network-diagnostics/network-check-target-rcsd4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:14.284928 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:14.284827 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68 podName:b9773745-b436-43ba-88b7-24316c1c1385 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:22.284805811 +0000 UTC m=+19.803477196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-56f68" (UniqueName: "kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68") pod "network-check-target-rcsd4" (UID: "b9773745-b436-43ba-88b7-24316c1c1385") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:14.551728 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:14.551656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:14.552204 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:14.551795 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:15.551112 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:15.551022 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:15.551277 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:15.551172 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:15.551556 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:15.551538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:15.551683 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:15.551664 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:16.551788 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:16.551760 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:16.552291 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:16.551862 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:17.550718 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:17.550680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:17.550900 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:17.550723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:17.550900 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:17.550816 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:17.551012 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:17.550953 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:18.550950 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:18.550921 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:18.551500 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:18.551054 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:19.550959 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:19.550923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:19.551372 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:19.550931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:19.551372 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:19.551057 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:19.551372 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:19.551138 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:20.551246 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:20.551209 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:20.551644 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:20.551320 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:21.550909 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:21.550875 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:21.550909 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:21.550909 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:21.551109 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:21.551018 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:21.551153 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:21.551116 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:22.140326 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:22.140291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:22.140739 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:22.140436 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:22.140739 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:22.140514 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs podName:03823fc1-c5c8-471d-825a-256e029b9bce nodeName:}" failed. No retries permitted until 2026-09-18 04:21:38.140494651 +0000 UTC m=+35.659166024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs") pod "network-metrics-daemon-fn5bz" (UID: "03823fc1-c5c8-471d-825a-256e029b9bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:22.241063 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:22.241016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:22.241227 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:22.241136 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:22.241227 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:22.241210 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret podName:e3fd06a6-c6b4-4f66-9f86-d9857a390bd1 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:38.241193242 +0000 UTC m=+35.759864618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret") pod "global-pull-secret-syncer-4fncm" (UID: "e3fd06a6-c6b4-4f66-9f86-d9857a390bd1") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:22.341829 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:22.341795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56f68\" (UniqueName: \"kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68\") pod \"network-check-target-rcsd4\" (UID: \"b9773745-b436-43ba-88b7-24316c1c1385\") " pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:22.341997 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:22.341969 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:21:22.341997 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:22.341991 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:21:22.342105 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:22.342001 2562 projected.go:196] Error preparing data for projected volume kube-api-access-56f68 for pod openshift-network-diagnostics/network-check-target-rcsd4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:22.342105 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:22.342064 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68 podName:b9773745-b436-43ba-88b7-24316c1c1385 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:38.342050257 +0000 UTC m=+35.860721630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-56f68" (UniqueName: "kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68") pod "network-check-target-rcsd4" (UID: "b9773745-b436-43ba-88b7-24316c1c1385") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:22.551226 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:22.551134 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:22.551393 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:22.551272 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:23.551712 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:23.551679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:23.552177 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:23.551803 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:23.552177 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:23.551852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:23.552177 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:23.551954 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:24.552008 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:24.551976 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:24.552460 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:24.552075 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:25.551173 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.550868 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:25.551296 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.550936 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:25.551296 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:25.551249 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:25.551371 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:25.551345 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:25.722494 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.722385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5x27n" event={"ID":"d7a3defb-be96-4c25-80b8-72fbb9998a24","Type":"ContainerStarted","Data":"57121f1163a90072dcb9d2babf4357ea67a791be993b24bcb4800b369bbbdad3"} Sep 18 04:21:25.724151 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.724121 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cpcdt" event={"ID":"0226753d-8c5a-48b5-9c7b-583e15617548","Type":"ContainerStarted","Data":"b2f3168115c76c648494263f34f7d4a695ebef3f21a02741920ad19a24884445"} Sep 18 04:21:25.727701 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.727669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" event={"ID":"c47c4573-b277-4a8a-8aee-d5b81b9275dd","Type":"ContainerStarted","Data":"951a548011393a43b7fa4eae7439e0d0941a826325e4d0a3496ea37bcd458f2b"} Sep 18 04:21:25.727845 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.727737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" event={"ID":"c47c4573-b277-4a8a-8aee-d5b81b9275dd","Type":"ContainerStarted","Data":"aec3026fc8ffdfd6b5c71119a237c6787f2a21165acf44ee67cd7567b39bd46d"} Sep 18 04:21:25.727845 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.727789 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" event={"ID":"c47c4573-b277-4a8a-8aee-d5b81b9275dd","Type":"ContainerStarted","Data":"6f42c2ec33837310cf8ea9899464ae147023bf9a19002daa75f325fd44b99a0d"} Sep 18 04:21:25.727845 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.727840 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" event={"ID":"c47c4573-b277-4a8a-8aee-d5b81b9275dd","Type":"ContainerStarted","Data":"a71f736c4d6c1ceb4a49721bc7352081c6615f9132c26bd04d4b4469385223b4"} Sep 18 04:21:25.727966 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.727873 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" event={"ID":"c47c4573-b277-4a8a-8aee-d5b81b9275dd","Type":"ContainerStarted","Data":"153add85248b1941d673981e33b75fd5399c21e50e144c646823ba0fdd0f5c00"} Sep 18 04:21:25.727966 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.727900 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" event={"ID":"c47c4573-b277-4a8a-8aee-d5b81b9275dd","Type":"ContainerStarted","Data":"674a4301687154686ca9ddf8afa9f7946857458cbbf7719d19fb418ed3070fe5"} Sep 18 04:21:25.729422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.729387 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rhb9v" event={"ID":"5810a0f6-ab3e-4945-8090-c6623fc2c473","Type":"ContainerStarted","Data":"35bd150b5f6d29e6e1503cbc6cc56efb3d44bd796ae5b32187a1914bcaf8ec84"} Sep 18 04:21:25.730999 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.730976 2562 generic.go:356] "Generic (PLEG): container finished" podID="1abb6f25-c656-4523-a5f7-d347cc63b7e2" containerID="b7dc6c57df67085f2d6692d162eeb3d3bc483e619026af803f9b739e0f8f8ae5" exitCode=0 Sep 18 04:21:25.731101 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.731058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" event={"ID":"1abb6f25-c656-4523-a5f7-d347cc63b7e2","Type":"ContainerDied","Data":"b7dc6c57df67085f2d6692d162eeb3d3bc483e619026af803f9b739e0f8f8ae5"} Sep 18 04:21:25.732979 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.732958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vcktx" event={"ID":"7c7da603-41c7-4ead-adda-af15986dda34","Type":"ContainerStarted","Data":"ba22aa3302bef438d0e279b9f3274eb5446def8eaa241fee6ab9b002986dcadc"} Sep 18 04:21:25.734756 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.734732 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" event={"ID":"99799489-168c-4a1a-a647-1012c3958779","Type":"ContainerStarted","Data":"59c34302d0cbd9cf724681419b86c60f1e66805dd5b74ee0e8d6c36eb26e83b4"} Sep 18 04:21:25.736366 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.736344 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-krsb8" event={"ID":"353a5565-874a-4a0e-b82d-986e698a2a36","Type":"ContainerStarted","Data":"824443668d98fe9cc8ce85f20a9a0aa81c267ffdb4bc20271911899fd5f26ce2"} Sep 18 04:21:25.761143 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.761098 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5x27n" podStartSLOduration=4.365455428 podStartE2EDuration="21.761084449s" totalImagesPullingTime="17.395629021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:25.743676585 +0000 UTC m=+23.262348004" watchObservedRunningTime="2026-09-18 04:21:25.761084449 +0000 UTC m=+23.279755840" Sep 18 04:21:25.777374 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.777329 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cpcdt" podStartSLOduration=4.391417109 podStartE2EDuration="21.777315804s" totalImagesPullingTime="17.385898695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:25.761402876 +0000 UTC m=+23.280074290" watchObservedRunningTime="2026-09-18 04:21:25.777315804 +0000 UTC m=+23.295987195" Sep 18 04:21:25.777593 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.777572 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rhb9v" podStartSLOduration=11.891123237 podStartE2EDuration="21.777567992s" totalImagesPullingTime="9.886444755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:25.777127702 +0000 UTC m=+23.295799120" watchObservedRunningTime="2026-09-18 04:21:25.777567992 +0000 UTC m=+23.296239383" Sep 18 04:21:25.838192 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.838127 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vcktx" podStartSLOduration=4.437221242 podStartE2EDuration="21.838109292s" totalImagesPullingTime="17.40088805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:25.817688207 +0000 UTC m=+23.336359732" watchObservedRunningTime="2026-09-18 04:21:25.838109292 +0000 UTC m=+23.356780684" Sep 18 04:21:25.838347 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:25.838322 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-krsb8" podStartSLOduration=4.481733781 podStartE2EDuration="21.838312868s" totalImagesPullingTime="17.356579087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:25.838265553 +0000 UTC m=+23.356936928" watchObservedRunningTime="2026-09-18 04:21:25.838312868 +0000 UTC m=+23.356984261" Sep 18 04:21:26.152122 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.152100 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 04:21:26.497126 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.496993 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T04:21:26.152117974Z","UUID":"3018a29c-9693-4ee5-a40c-d89a691b47c7","Handler":null,"Name":"","Endpoint":""} Sep 18 04:21:26.498539 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.498522 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 04:21:26.498628 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.498551 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 04:21:26.551009 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.550977 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:26.551190 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:26.551102 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:26.586504 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.586475 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:26.586942 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.586927 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:26.740434 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.740353 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" event={"ID":"99799489-168c-4a1a-a647-1012c3958779","Type":"ContainerStarted","Data":"7f81ea30472a762df7d882621551e79b97ee02d1e61bb97ead381f02b7caacfe"} Sep 18 04:21:26.742191 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.742123 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tpsd2" event={"ID":"a1f39bd3-36aa-4c9b-b362-e58a3ba27a05","Type":"ContainerStarted","Data":"c66be0ea683f11585533183f3ea153dd6a2f7b18202a890e06467a1b83e4aa81"} Sep 18 04:21:26.742824 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.742805 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:26.743301 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.743282 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rhb9v" Sep 18 04:21:26.770921 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:26.770880 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tpsd2" podStartSLOduration=5.377867778 podStartE2EDuration="22.770867381s" totalImagesPullingTime="17.392999603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:26.75632214 +0000 UTC m=+24.274993551" watchObservedRunningTime="2026-09-18 04:21:26.770867381 +0000 UTC m=+24.289538809" Sep 18 04:21:27.550663 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:27.550643 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:27.550775 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:27.550650 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:27.550775 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:27.550757 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:27.550888 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:27.550864 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:27.748645 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:27.748605 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" event={"ID":"c47c4573-b277-4a8a-8aee-d5b81b9275dd","Type":"ContainerStarted","Data":"db43e5a84d200ab1b0966f41cd68a0e23b8a32c160360f635e72e0f0b696afb6"} Sep 18 04:21:27.751062 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:27.751007 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" event={"ID":"99799489-168c-4a1a-a647-1012c3958779","Type":"ContainerStarted","Data":"57f0c46e5fa68424b4ba24f1311c2b6a53225463b4cf98f3aa64fe76a803b756"} Sep 18 04:21:27.773258 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:27.773168 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wq47p" podStartSLOduration=4.527151929 podStartE2EDuration="23.773155415s" totalImagesPullingTime="19.246003486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:27.773014695 +0000 UTC m=+25.291686151" watchObservedRunningTime="2026-09-18 04:21:27.773155415 +0000 UTC m=+25.291826819" Sep 18 04:21:28.550846 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:28.550815 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:28.551022 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:28.550939 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:29.550822 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:29.550790 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:29.551219 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:29.550827 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:29.551219 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:29.550920 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:29.551219 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:29.551045 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:30.551073 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:30.550852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:30.551904 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:30.551140 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:30.759564 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:30.759527 2562 generic.go:356] "Generic (PLEG): container finished" podID="1abb6f25-c656-4523-a5f7-d347cc63b7e2" containerID="49aece9e7b0ad68056456f53c0544606380e0f08e6266f7ad58660dda8d1a670" exitCode=0 Sep 18 04:21:30.759745 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:30.759613 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" event={"ID":"1abb6f25-c656-4523-a5f7-d347cc63b7e2","Type":"ContainerDied","Data":"49aece9e7b0ad68056456f53c0544606380e0f08e6266f7ad58660dda8d1a670"} Sep 18 04:21:30.763769 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:30.763742 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" event={"ID":"c47c4573-b277-4a8a-8aee-d5b81b9275dd","Type":"ContainerStarted","Data":"8a6a5a0bd8c76f1208ae74bf6f24711175b3c3e14084475f5ebcabb57f7bdb2a"} Sep 18 04:21:30.764072 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:30.764056 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:30.764167 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:30.764120 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:30.764231 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:30.764171 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:30.779730 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:30.779706 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:30.779853 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:30.779821 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:21:30.805412 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:30.805285 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" podStartSLOduration=9.380309506 podStartE2EDuration="26.805265506s" totalImagesPullingTime="17.424956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:30.804095727 +0000 UTC m=+28.322767117" watchObservedRunningTime="2026-09-18 04:21:30.805265506 +0000 UTC m=+28.323936898" Sep 18 04:21:31.551769 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:31.551733 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:31.551769 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:31.551767 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:31.552315 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:31.551870 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:31.552315 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:31.552045 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:31.886892 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:31.886665 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4fncm"] Sep 18 04:21:31.887222 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:31.887194 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:31.887343 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:31.887319 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:31.889903 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:31.889878 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fn5bz"] Sep 18 04:21:31.889998 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:31.889969 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:31.890114 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:31.890093 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:31.890546 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:31.890529 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rcsd4"] Sep 18 04:21:31.890605 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:31.890595 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:31.890701 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:31.890675 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:32.770017 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:32.769986 2562 generic.go:356] "Generic (PLEG): container finished" podID="1abb6f25-c656-4523-a5f7-d347cc63b7e2" containerID="3fefc7d8550efa43faf03bdaea592ace384922565c136629cdbb08374ce5c5aa" exitCode=0 Sep 18 04:21:32.770413 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:32.770060 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" event={"ID":"1abb6f25-c656-4523-a5f7-d347cc63b7e2","Type":"ContainerDied","Data":"3fefc7d8550efa43faf03bdaea592ace384922565c136629cdbb08374ce5c5aa"} Sep 18 04:21:33.551339 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:33.551310 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:33.551491 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:33.551343 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:33.551491 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:33.551405 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:33.551588 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:33.551497 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:33.551588 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:33.551537 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:33.551658 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:33.551610 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:34.776070 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:34.776018 2562 generic.go:356] "Generic (PLEG): container finished" podID="1abb6f25-c656-4523-a5f7-d347cc63b7e2" containerID="e4f9013109959ef8c58a149038383c1593f5127be2e2b80b07f58a14c1240ea6" exitCode=0 Sep 18 04:21:34.776523 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:34.776082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" event={"ID":"1abb6f25-c656-4523-a5f7-d347cc63b7e2","Type":"ContainerDied","Data":"e4f9013109959ef8c58a149038383c1593f5127be2e2b80b07f58a14c1240ea6"} Sep 18 04:21:35.550821 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:35.550784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:35.550821 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:35.550817 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:35.551159 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:35.550828 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:35.551159 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:35.550923 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:35.551159 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:35.550985 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:35.551318 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:35.551172 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:36.952451 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:36.952426 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cpcdt_0226753d-8c5a-48b5-9c7b-583e15617548/dns-node-resolver/0.log" Sep 18 04:21:37.551736 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:37.551499 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:37.551963 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:37.551555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:37.551963 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:37.551841 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4fncm" podUID="e3fd06a6-c6b4-4f66-9f86-d9857a390bd1" Sep 18 04:21:37.551963 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:37.551559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:37.551963 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:37.551910 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn5bz" podUID="03823fc1-c5c8-471d-825a-256e029b9bce" Sep 18 04:21:37.552244 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:37.551998 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcsd4" podUID="b9773745-b436-43ba-88b7-24316c1c1385" Sep 18 04:21:38.037133 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:38.037103 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-31.ec2.internal" event="NodeReady" Sep 18 04:21:38.037676 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:38.037236 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 04:21:38.119076 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:38.119048 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-krsb8_353a5565-874a-4a0e-b82d-986e698a2a36/node-ca/0.log" Sep 18 04:21:38.168306 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:38.168265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:38.168481 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:38.168412 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:38.168538 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:38.168483 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs podName:03823fc1-c5c8-471d-825a-256e029b9bce nodeName:}" failed. No retries permitted until 2026-09-18 04:22:10.168460768 +0000 UTC m=+67.687132160 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs") pod "network-metrics-daemon-fn5bz" (UID: "03823fc1-c5c8-471d-825a-256e029b9bce") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:38.268889 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:38.268845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:38.269158 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:38.268975 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:38.269158 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:38.269073 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret podName:e3fd06a6-c6b4-4f66-9f86-d9857a390bd1 nodeName:}" failed. No retries permitted until 2026-09-18 04:22:10.269051311 +0000 UTC m=+67.787722695 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret") pod "global-pull-secret-syncer-4fncm" (UID: "e3fd06a6-c6b4-4f66-9f86-d9857a390bd1") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:38.369533 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:38.369494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56f68\" (UniqueName: \"kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68\") pod \"network-check-target-rcsd4\" (UID: \"b9773745-b436-43ba-88b7-24316c1c1385\") " pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:38.369756 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:38.369696 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:21:38.369756 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:38.369723 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:21:38.369756 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:38.369736 2562 projected.go:196] Error preparing data for projected volume kube-api-access-56f68 for pod openshift-network-diagnostics/network-check-target-rcsd4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:38.369901 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:21:38.369806 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68 podName:b9773745-b436-43ba-88b7-24316c1c1385 nodeName:}" failed. No retries permitted until 2026-09-18 04:22:10.369786268 +0000 UTC m=+67.888457641 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-56f68" (UniqueName: "kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68") pod "network-check-target-rcsd4" (UID: "b9773745-b436-43ba-88b7-24316c1c1385") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:39.551693 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:39.551654 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:21:39.552239 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:39.551704 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:21:39.552239 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:39.551656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:21:39.558781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:39.558759 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 04:21:39.558781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:39.558776 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 04:21:39.559626 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:39.559603 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 04:21:39.559710 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:39.559643 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2kz7\"" Sep 18 04:21:39.559893 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:39.559873 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-psk8d\"" Sep 18 04:21:39.560095 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:39.560078 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 04:21:39.790502 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:39.790470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" event={"ID":"1abb6f25-c656-4523-a5f7-d347cc63b7e2","Type":"ContainerStarted","Data":"62a68235365d809a1bcc5810ce2c11e3b33faf4a1bc37505dad8fddc72f00851"} Sep 18 04:21:40.795017 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:40.794988 2562 generic.go:356] "Generic (PLEG): container finished" podID="1abb6f25-c656-4523-a5f7-d347cc63b7e2" containerID="62a68235365d809a1bcc5810ce2c11e3b33faf4a1bc37505dad8fddc72f00851" exitCode=0 Sep 18 04:21:40.795663 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:40.795070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" event={"ID":"1abb6f25-c656-4523-a5f7-d347cc63b7e2","Type":"ContainerDied","Data":"62a68235365d809a1bcc5810ce2c11e3b33faf4a1bc37505dad8fddc72f00851"} Sep 18 04:21:41.800593 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:41.800511 2562 generic.go:356] "Generic (PLEG): container finished" podID="1abb6f25-c656-4523-a5f7-d347cc63b7e2" containerID="f08a17f7582a2d0625c6dc8ec35875a2c47c843500b6eef35c3e13b0b7223d5f" exitCode=0 Sep 18 04:21:41.800593 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:41.800557 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" event={"ID":"1abb6f25-c656-4523-a5f7-d347cc63b7e2","Type":"ContainerDied","Data":"f08a17f7582a2d0625c6dc8ec35875a2c47c843500b6eef35c3e13b0b7223d5f"} Sep 18 04:21:42.806222 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:42.806193 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" event={"ID":"1abb6f25-c656-4523-a5f7-d347cc63b7e2","Type":"ContainerStarted","Data":"b2c382f09572f10616ea5d986dd31d8bf104117ecb44b7ea7b9def72a1d6e67f"} Sep 18 04:21:42.829945 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:42.829901 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zxkjc" podStartSLOduration=9.827907431 podStartE2EDuration="38.829887848s" totalImagesPullingTime="29.001980417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:42.829026657 +0000 UTC m=+40.347698061" watchObservedRunningTime="2026-09-18 04:21:42.829887848 +0000 UTC m=+40.348559238" Sep 18 04:21:58.682320 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.682286 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5984d95969-qtdsz"] Sep 18 04:21:58.720148 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.720110 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5984d95969-qtdsz"] Sep 18 04:21:58.720306 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.720220 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.724002 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.723971 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 04:21:58.724221 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.724098 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-72469\"" Sep 18 04:21:58.724457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.724439 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 04:21:58.724860 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.724845 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 04:21:58.728981 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.728962 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 04:21:58.785356 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.785334 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xnsv6"] Sep 18 04:21:58.804554 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.804534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de68f5db-4441-4a3d-aa80-b2b200f439ca-bound-sa-token\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.804655 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.804565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de68f5db-4441-4a3d-aa80-b2b200f439ca-ca-trust-extracted\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.804655 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.804580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de68f5db-4441-4a3d-aa80-b2b200f439ca-trusted-ca\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.804655 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.804596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de68f5db-4441-4a3d-aa80-b2b200f439ca-registry-tls\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.804655 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.804621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de68f5db-4441-4a3d-aa80-b2b200f439ca-installation-pull-secrets\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.804655 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.804638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de68f5db-4441-4a3d-aa80-b2b200f439ca-registry-certificates\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.804835 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.804705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8ksw\" (UniqueName: \"kubernetes.io/projected/de68f5db-4441-4a3d-aa80-b2b200f439ca-kube-api-access-d8ksw\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.804835 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.804737 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de68f5db-4441-4a3d-aa80-b2b200f439ca-image-registry-private-configuration\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.811757 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.811740 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lwpz9"] Sep 18 04:21:58.811898 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.811880 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:58.816541 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.816521 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d79fv\"" Sep 18 04:21:58.816818 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.816799 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 04:21:58.816909 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.816802 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 04:21:58.835696 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.835679 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-bf7c2"] Sep 18 04:21:58.835797 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.835782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:58.838784 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.838761 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5pnhd\"" Sep 18 04:21:58.838871 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.838844 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 04:21:58.839355 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.839342 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 04:21:58.839674 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.839646 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 04:21:58.839819 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.839803 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 04:21:58.859713 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.859689 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lwpz9"] Sep 18 04:21:58.859813 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.859732 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xnsv6"] Sep 18 04:21:58.859813 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.859760 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-bf7c2"] Sep 18 04:21:58.859918 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.859847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-bf7c2" Sep 18 04:21:58.862025 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.862004 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 04:21:58.862126 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.862073 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 04:21:58.862126 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.862073 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-msv94\"" Sep 18 04:21:58.878736 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.878710 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m2r6c"] Sep 18 04:21:58.895828 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.895804 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m2r6c" Sep 18 04:21:58.898235 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.898216 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rswht\"" Sep 18 04:21:58.898552 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.898536 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 04:21:58.898644 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.898566 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 04:21:58.898756 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.898743 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 04:21:58.903654 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.903623 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m2r6c"] Sep 18 04:21:58.905816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.905799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de68f5db-4441-4a3d-aa80-b2b200f439ca-ca-trust-extracted\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.905914 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.905823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de68f5db-4441-4a3d-aa80-b2b200f439ca-trusted-ca\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.905914 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.905841 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de68f5db-4441-4a3d-aa80-b2b200f439ca-registry-tls\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.905914 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.905857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de68f5db-4441-4a3d-aa80-b2b200f439ca-installation-pull-secrets\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.905914 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.905878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqqnl\" (UniqueName: \"kubernetes.io/projected/234101be-031b-4b9e-a70a-41726aaf8450-kube-api-access-vqqnl\") pod \"ingress-canary-m2r6c\" (UID: \"234101be-031b-4b9e-a70a-41726aaf8450\") " pod="openshift-ingress-canary/ingress-canary-m2r6c" Sep 18 04:21:58.905914 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.905901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f1119c2-84eb-4286-8c85-52afcd8d77b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:58.906147 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.905923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvs62\" (UniqueName: \"kubernetes.io/projected/546d87b4-faeb-49cc-b512-958f38fb56f7-kube-api-access-hvs62\") pod \"downloads-6594f4c75-bf7c2\" (UID: \"546d87b4-faeb-49cc-b512-958f38fb56f7\") " pod="openshift-console/downloads-6594f4c75-bf7c2" Sep 18 04:21:58.906327 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.906293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6790211c-1eb7-422b-b94e-e7782817e629-config-volume\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:58.906683 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.906663 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de68f5db-4441-4a3d-aa80-b2b200f439ca-ca-trust-extracted\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.906773 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.906756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de68f5db-4441-4a3d-aa80-b2b200f439ca-registry-certificates\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907074 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6790211c-1eb7-422b-b94e-e7782817e629-metrics-tls\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907130 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de68f5db-4441-4a3d-aa80-b2b200f439ca-trusted-ca\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8ksw\" (UniqueName: \"kubernetes.io/projected/de68f5db-4441-4a3d-aa80-b2b200f439ca-kube-api-access-d8ksw\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f1119c2-84eb-4286-8c85-52afcd8d77b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv8cf\" (UniqueName: \"kubernetes.io/projected/6f1119c2-84eb-4286-8c85-52afcd8d77b2-kube-api-access-fv8cf\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6790211c-1eb7-422b-b94e-e7782817e629-tmp-dir\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de68f5db-4441-4a3d-aa80-b2b200f439ca-image-registry-private-configuration\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/234101be-031b-4b9e-a70a-41726aaf8450-cert\") pod \"ingress-canary-m2r6c\" (UID: \"234101be-031b-4b9e-a70a-41726aaf8450\") " pod="openshift-ingress-canary/ingress-canary-m2r6c" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prtg8\" (UniqueName: \"kubernetes.io/projected/6790211c-1eb7-422b-b94e-e7782817e629-kube-api-access-prtg8\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de68f5db-4441-4a3d-aa80-b2b200f439ca-bound-sa-token\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.907433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f1119c2-84eb-4286-8c85-52afcd8d77b2-crio-socket\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:58.907963 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907445 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de68f5db-4441-4a3d-aa80-b2b200f439ca-registry-certificates\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.907963 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.907467 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1119c2-84eb-4286-8c85-52afcd8d77b2-data-volume\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:58.911946 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.911925 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de68f5db-4441-4a3d-aa80-b2b200f439ca-registry-tls\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.912023 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.911963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de68f5db-4441-4a3d-aa80-b2b200f439ca-image-registry-private-configuration\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.912674 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.912656 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de68f5db-4441-4a3d-aa80-b2b200f439ca-installation-pull-secrets\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.919207 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.919188 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8ksw\" (UniqueName: \"kubernetes.io/projected/de68f5db-4441-4a3d-aa80-b2b200f439ca-kube-api-access-d8ksw\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:58.924012 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:58.923994 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de68f5db-4441-4a3d-aa80-b2b200f439ca-bound-sa-token\") pod \"image-registry-5984d95969-qtdsz\" (UID: \"de68f5db-4441-4a3d-aa80-b2b200f439ca\") " pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:59.008478 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f1119c2-84eb-4286-8c85-52afcd8d77b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.008478 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv8cf\" (UniqueName: \"kubernetes.io/projected/6f1119c2-84eb-4286-8c85-52afcd8d77b2-kube-api-access-fv8cf\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.008478 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6790211c-1eb7-422b-b94e-e7782817e629-tmp-dir\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:59.008745 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008583 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/234101be-031b-4b9e-a70a-41726aaf8450-cert\") pod \"ingress-canary-m2r6c\" (UID: \"234101be-031b-4b9e-a70a-41726aaf8450\") " pod="openshift-ingress-canary/ingress-canary-m2r6c" Sep 18 04:21:59.008745 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prtg8\" (UniqueName: \"kubernetes.io/projected/6790211c-1eb7-422b-b94e-e7782817e629-kube-api-access-prtg8\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:59.008745 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f1119c2-84eb-4286-8c85-52afcd8d77b2-crio-socket\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.008745 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1119c2-84eb-4286-8c85-52afcd8d77b2-data-volume\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.008941 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqqnl\" (UniqueName: \"kubernetes.io/projected/234101be-031b-4b9e-a70a-41726aaf8450-kube-api-access-vqqnl\") pod \"ingress-canary-m2r6c\" (UID: \"234101be-031b-4b9e-a70a-41726aaf8450\") " pod="openshift-ingress-canary/ingress-canary-m2r6c" Sep 18 04:21:59.008941 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f1119c2-84eb-4286-8c85-52afcd8d77b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.008941 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008786 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6790211c-1eb7-422b-b94e-e7782817e629-tmp-dir\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:59.008941 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008817 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvs62\" (UniqueName: \"kubernetes.io/projected/546d87b4-faeb-49cc-b512-958f38fb56f7-kube-api-access-hvs62\") pod \"downloads-6594f4c75-bf7c2\" (UID: \"546d87b4-faeb-49cc-b512-958f38fb56f7\") " pod="openshift-console/downloads-6594f4c75-bf7c2" Sep 18 04:21:59.008941 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6790211c-1eb7-422b-b94e-e7782817e629-config-volume\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:59.008941 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6790211c-1eb7-422b-b94e-e7782817e629-metrics-tls\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:59.008941 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008912 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f1119c2-84eb-4286-8c85-52afcd8d77b2-crio-socket\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.009296 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.008998 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f1119c2-84eb-4286-8c85-52afcd8d77b2-data-volume\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.009558 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.009533 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f1119c2-84eb-4286-8c85-52afcd8d77b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.009654 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.009567 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6790211c-1eb7-422b-b94e-e7782817e629-config-volume\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:59.010849 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.010825 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f1119c2-84eb-4286-8c85-52afcd8d77b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.010971 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.010955 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/234101be-031b-4b9e-a70a-41726aaf8450-cert\") pod \"ingress-canary-m2r6c\" (UID: \"234101be-031b-4b9e-a70a-41726aaf8450\") " pod="openshift-ingress-canary/ingress-canary-m2r6c" Sep 18 04:21:59.011143 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.011123 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6790211c-1eb7-422b-b94e-e7782817e629-metrics-tls\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:59.023510 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.023487 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvs62\" (UniqueName: \"kubernetes.io/projected/546d87b4-faeb-49cc-b512-958f38fb56f7-kube-api-access-hvs62\") pod \"downloads-6594f4c75-bf7c2\" (UID: \"546d87b4-faeb-49cc-b512-958f38fb56f7\") " pod="openshift-console/downloads-6594f4c75-bf7c2" Sep 18 04:21:59.023611 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.023521 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prtg8\" (UniqueName: \"kubernetes.io/projected/6790211c-1eb7-422b-b94e-e7782817e629-kube-api-access-prtg8\") pod \"dns-default-xnsv6\" (UID: \"6790211c-1eb7-422b-b94e-e7782817e629\") " pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:59.024185 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.024169 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv8cf\" (UniqueName: \"kubernetes.io/projected/6f1119c2-84eb-4286-8c85-52afcd8d77b2-kube-api-access-fv8cf\") pod \"insights-runtime-extractor-lwpz9\" (UID: \"6f1119c2-84eb-4286-8c85-52afcd8d77b2\") " pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.025302 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.025282 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqqnl\" (UniqueName: \"kubernetes.io/projected/234101be-031b-4b9e-a70a-41726aaf8450-kube-api-access-vqqnl\") pod \"ingress-canary-m2r6c\" (UID: \"234101be-031b-4b9e-a70a-41726aaf8450\") " pod="openshift-ingress-canary/ingress-canary-m2r6c" Sep 18 04:21:59.029131 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.029112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:59.121401 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.121365 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xnsv6" Sep 18 04:21:59.144457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.144432 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lwpz9" Sep 18 04:21:59.167537 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.167515 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-bf7c2" Sep 18 04:21:59.204289 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.204260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m2r6c" Sep 18 04:21:59.388118 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.388086 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5984d95969-qtdsz"] Sep 18 04:21:59.391497 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:59.391458 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde68f5db_4441_4a3d_aa80_b2b200f439ca.slice/crio-49da46eaa42df6ec5260933fc6d596dcbb5f8f48e685e4d138ba4256cd92f563 WatchSource:0}: Error finding container 49da46eaa42df6ec5260933fc6d596dcbb5f8f48e685e4d138ba4256cd92f563: Status 404 returned error can't find the container with id 49da46eaa42df6ec5260933fc6d596dcbb5f8f48e685e4d138ba4256cd92f563 Sep 18 04:21:59.411295 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.411274 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xnsv6"] Sep 18 04:21:59.413809 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:59.413784 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6790211c_1eb7_422b_b94e_e7782817e629.slice/crio-af91520331f479e4148731137fc3a0256d0a338475fe0f9c2c69d8746c1cbca6 WatchSource:0}: Error finding container af91520331f479e4148731137fc3a0256d0a338475fe0f9c2c69d8746c1cbca6: Status 404 returned error can't find the container with id af91520331f479e4148731137fc3a0256d0a338475fe0f9c2c69d8746c1cbca6 Sep 18 04:21:59.440396 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.440369 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lwpz9"] Sep 18 04:21:59.443781 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:59.443759 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1119c2_84eb_4286_8c85_52afcd8d77b2.slice/crio-e38ffe96f75b668825936f3fb1574beb1a239eee81f92f13dab61ddcd3d225f7 WatchSource:0}: Error finding container e38ffe96f75b668825936f3fb1574beb1a239eee81f92f13dab61ddcd3d225f7: Status 404 returned error can't find the container with id e38ffe96f75b668825936f3fb1574beb1a239eee81f92f13dab61ddcd3d225f7 Sep 18 04:21:59.458526 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.458502 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-bf7c2"] Sep 18 04:21:59.467937 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:59.467912 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546d87b4_faeb_49cc_b512_958f38fb56f7.slice/crio-82e36bed78bd465d6544a861fafe967311f2da8b95bd156558b56cf9ff5bd13c WatchSource:0}: Error finding container 82e36bed78bd465d6544a861fafe967311f2da8b95bd156558b56cf9ff5bd13c: Status 404 returned error can't find the container with id 82e36bed78bd465d6544a861fafe967311f2da8b95bd156558b56cf9ff5bd13c Sep 18 04:21:59.489491 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.489467 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m2r6c"] Sep 18 04:21:59.501923 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:21:59.501902 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234101be_031b_4b9e_a70a_41726aaf8450.slice/crio-c0df1ea62185eef65a500688fddd23ec2305331168702a40dc243aafcb67bc86 WatchSource:0}: Error finding container c0df1ea62185eef65a500688fddd23ec2305331168702a40dc243aafcb67bc86: Status 404 returned error can't find the container with id c0df1ea62185eef65a500688fddd23ec2305331168702a40dc243aafcb67bc86 Sep 18 04:21:59.848116 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.848051 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwpz9" event={"ID":"6f1119c2-84eb-4286-8c85-52afcd8d77b2","Type":"ContainerStarted","Data":"3d6131feded2c994ca5503b110dd5cfd8f3835bf209b651f1c92d60ac0a6719f"} Sep 18 04:21:59.848116 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.848120 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwpz9" event={"ID":"6f1119c2-84eb-4286-8c85-52afcd8d77b2","Type":"ContainerStarted","Data":"e38ffe96f75b668825936f3fb1574beb1a239eee81f92f13dab61ddcd3d225f7"} Sep 18 04:21:59.849418 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.849383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnsv6" event={"ID":"6790211c-1eb7-422b-b94e-e7782817e629","Type":"ContainerStarted","Data":"af91520331f479e4148731137fc3a0256d0a338475fe0f9c2c69d8746c1cbca6"} Sep 18 04:21:59.851208 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.851185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5984d95969-qtdsz" event={"ID":"de68f5db-4441-4a3d-aa80-b2b200f439ca","Type":"ContainerStarted","Data":"c38d909229ac8a8f6fd8ceaf446743b0d9fb970e4142796e7377f389eee73997"} Sep 18 04:21:59.851320 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.851227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5984d95969-qtdsz" event={"ID":"de68f5db-4441-4a3d-aa80-b2b200f439ca","Type":"ContainerStarted","Data":"49da46eaa42df6ec5260933fc6d596dcbb5f8f48e685e4d138ba4256cd92f563"} Sep 18 04:21:59.851320 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.851305 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:21:59.852585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.852560 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-bf7c2" event={"ID":"546d87b4-faeb-49cc-b512-958f38fb56f7","Type":"ContainerStarted","Data":"82e36bed78bd465d6544a861fafe967311f2da8b95bd156558b56cf9ff5bd13c"} Sep 18 04:21:59.853838 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.853815 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m2r6c" event={"ID":"234101be-031b-4b9e-a70a-41726aaf8450","Type":"ContainerStarted","Data":"c0df1ea62185eef65a500688fddd23ec2305331168702a40dc243aafcb67bc86"} Sep 18 04:21:59.873986 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:21:59.873926 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5984d95969-qtdsz" podStartSLOduration=1.873884044 podStartE2EDuration="1.873884044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:59.872779986 +0000 UTC m=+57.391451400" watchObservedRunningTime="2026-09-18 04:21:59.873884044 +0000 UTC m=+57.392555436" Sep 18 04:22:01.766792 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:01.766756 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq"] Sep 18 04:22:01.786722 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:01.786644 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq"] Sep 18 04:22:01.786866 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:01.786764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" Sep 18 04:22:01.789123 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:01.789095 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 04:22:01.789289 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:01.789101 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rwn8z\"" Sep 18 04:22:01.833175 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:01.833149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02dd49a2-307d-4f97-a93a-6a07c6f2b4ac-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fsrhq\" (UID: \"02dd49a2-307d-4f97-a93a-6a07c6f2b4ac\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" Sep 18 04:22:01.933788 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:01.933698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02dd49a2-307d-4f97-a93a-6a07c6f2b4ac-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fsrhq\" (UID: \"02dd49a2-307d-4f97-a93a-6a07c6f2b4ac\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" Sep 18 04:22:01.933948 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:01.933878 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 18 04:22:01.934018 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:01.933951 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02dd49a2-307d-4f97-a93a-6a07c6f2b4ac-tls-certificates podName:02dd49a2-307d-4f97-a93a-6a07c6f2b4ac nodeName:}" failed. No retries permitted until 2026-09-18 04:22:02.433930244 +0000 UTC m=+59.952601628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/02dd49a2-307d-4f97-a93a-6a07c6f2b4ac-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" (UID: "02dd49a2-307d-4f97-a93a-6a07c6f2b4ac") : secret "prometheus-operator-admission-webhook-tls" not found Sep 18 04:22:02.438558 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:02.438515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02dd49a2-307d-4f97-a93a-6a07c6f2b4ac-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fsrhq\" (UID: \"02dd49a2-307d-4f97-a93a-6a07c6f2b4ac\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" Sep 18 04:22:02.440974 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:02.440948 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02dd49a2-307d-4f97-a93a-6a07c6f2b4ac-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-fsrhq\" (UID: \"02dd49a2-307d-4f97-a93a-6a07c6f2b4ac\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" Sep 18 04:22:02.699951 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:02.699866 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" Sep 18 04:22:02.787273 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:02.787247 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxvht" Sep 18 04:22:03.077013 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:03.076911 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq"] Sep 18 04:22:03.086653 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:03.086621 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02dd49a2_307d_4f97_a93a_6a07c6f2b4ac.slice/crio-39403669f01fc071a854236b686e7125e126024ad8237e2e7ba1550e5e0f9c37 WatchSource:0}: Error finding container 39403669f01fc071a854236b686e7125e126024ad8237e2e7ba1550e5e0f9c37: Status 404 returned error can't find the container with id 39403669f01fc071a854236b686e7125e126024ad8237e2e7ba1550e5e0f9c37 Sep 18 04:22:03.872335 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:03.871777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m2r6c" event={"ID":"234101be-031b-4b9e-a70a-41726aaf8450","Type":"ContainerStarted","Data":"f16d961110139fecc666dddba0f4f8d73450f23a7a3cdb8d4e654a6d75b531d9"} Sep 18 04:22:03.875940 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:03.875830 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" event={"ID":"02dd49a2-307d-4f97-a93a-6a07c6f2b4ac","Type":"ContainerStarted","Data":"39403669f01fc071a854236b686e7125e126024ad8237e2e7ba1550e5e0f9c37"} Sep 18 04:22:03.878686 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:03.878611 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwpz9" event={"ID":"6f1119c2-84eb-4286-8c85-52afcd8d77b2","Type":"ContainerStarted","Data":"9c0a10e17ec41eea7d387bc6448e33b88950c18b6be10b2cd0125f78899654e2"} Sep 18 04:22:03.881425 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:03.880966 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnsv6" event={"ID":"6790211c-1eb7-422b-b94e-e7782817e629","Type":"ContainerStarted","Data":"024a79b1404133180a0159bab6bfbdd51fc1fd2888acc9e1d5ef5736c39b14b1"} Sep 18 04:22:03.881425 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:03.881008 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnsv6" event={"ID":"6790211c-1eb7-422b-b94e-e7782817e629","Type":"ContainerStarted","Data":"2f45118f85724414c73c9be6a04655491a5c12ed8431a59654dd8ae2e54c6a76"} Sep 18 04:22:03.881586 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:03.881425 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xnsv6" Sep 18 04:22:03.892321 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:03.892111 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m2r6c" podStartSLOduration=2.585037194 podStartE2EDuration="5.89209457s" totalImagesPullingTime="3.307057376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:03.890629553 +0000 UTC m=+61.409300945" watchObservedRunningTime="2026-09-18 04:22:03.89209457 +0000 UTC m=+61.410765955" Sep 18 04:22:03.910817 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:03.910654 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xnsv6" podStartSLOduration=2.522036403 podStartE2EDuration="5.910637961s" totalImagesPullingTime="3.388601558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:03.90860297 +0000 UTC m=+61.427274362" watchObservedRunningTime="2026-09-18 04:22:03.910637961 +0000 UTC m=+61.429309354" Sep 18 04:22:04.886181 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:04.886141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" event={"ID":"02dd49a2-307d-4f97-a93a-6a07c6f2b4ac","Type":"ContainerStarted","Data":"495d4e8a8718752a85b3bc4948b6b4b096c8cabf22ad8ba0e846d35241fdc37f"} Sep 18 04:22:04.886697 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:04.886344 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" Sep 18 04:22:04.889638 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:04.889606 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwpz9" event={"ID":"6f1119c2-84eb-4286-8c85-52afcd8d77b2","Type":"ContainerStarted","Data":"1720a5ca383f171b0f9d6f37c0d290258aece853fb40c6e27a0754a4dde73e44"} Sep 18 04:22:04.891907 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:04.891887 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" Sep 18 04:22:04.959896 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:04.959810 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-fsrhq" podStartSLOduration=2.360571238 podStartE2EDuration="3.959793975s" totalImagesPullingTime="1.599222737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:04.924078182 +0000 UTC m=+62.442749594" watchObservedRunningTime="2026-09-18 04:22:04.959793975 +0000 UTC m=+62.478465367" Sep 18 04:22:04.999469 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:04.999428 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lwpz9" podStartSLOduration=2.012104707 podStartE2EDuration="6.999411681s" totalImagesPullingTime="4.987306974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:04.960369717 +0000 UTC m=+62.479041133" watchObservedRunningTime="2026-09-18 04:22:04.999411681 +0000 UTC m=+62.518083072" Sep 18 04:22:05.883334 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.883301 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx"] Sep 18 04:22:05.888105 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.888083 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:05.892394 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.892373 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 04:22:05.893360 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.893332 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 04:22:05.897350 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.893486 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-24fks\"" Sep 18 04:22:05.897350 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.893676 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 04:22:05.897350 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.893784 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 04:22:05.897350 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.894264 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 04:22:05.906506 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.906485 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx"] Sep 18 04:22:05.966937 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.966919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjnf6\" (UniqueName: \"kubernetes.io/projected/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-kube-api-access-qjnf6\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:05.967081 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.966959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:05.967081 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.967017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:05.967201 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:05.967086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:06.067545 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:06.067509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjnf6\" (UniqueName: \"kubernetes.io/projected/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-kube-api-access-qjnf6\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:06.067733 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:06.067556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:06.067733 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:06.067587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:06.067733 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:06.067628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:06.067733 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:06.067724 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 18 04:22:06.067948 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:06.067798 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-prometheus-operator-tls podName:f0926b5c-e131-4a5d-8d2d-0fbaf75133da nodeName:}" failed. No retries permitted until 2026-09-18 04:22:06.56777859 +0000 UTC m=+64.086449963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-kqxxx" (UID: "f0926b5c-e131-4a5d-8d2d-0fbaf75133da") : secret "prometheus-operator-tls" not found Sep 18 04:22:06.068420 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:06.068372 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:06.070344 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:06.070323 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:06.083302 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:06.083276 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjnf6\" (UniqueName: \"kubernetes.io/projected/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-kube-api-access-qjnf6\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:06.572692 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:06.572659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:06.575465 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:06.575440 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0926b5c-e131-4a5d-8d2d-0fbaf75133da-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-kqxxx\" (UID: \"f0926b5c-e131-4a5d-8d2d-0fbaf75133da\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:06.802320 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:06.802287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" Sep 18 04:22:07.074915 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.074876 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx"] Sep 18 04:22:07.077794 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:07.077758 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0926b5c_e131_4a5d_8d2d_0fbaf75133da.slice/crio-eec4b78db4e11c5d970de8890c860d214b3773b596f7f841d2d9d9ff12c4462a WatchSource:0}: Error finding container eec4b78db4e11c5d970de8890c860d214b3773b596f7f841d2d9d9ff12c4462a: Status 404 returned error can't find the container with id eec4b78db4e11c5d970de8890c860d214b3773b596f7f841d2d9d9ff12c4462a Sep 18 04:22:07.380663 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.380630 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d545dfd7-s9qwt"] Sep 18 04:22:07.385146 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.385121 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.387626 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.387604 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 04:22:07.387751 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.387611 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 04:22:07.388198 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.388174 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lw858\"" Sep 18 04:22:07.388321 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.388207 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 04:22:07.388321 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.388226 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 04:22:07.388430 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.388370 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 04:22:07.395596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.395574 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d545dfd7-s9qwt"] Sep 18 04:22:07.479350 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.479307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-console-config\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.479527 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.479360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq2lx\" (UniqueName: \"kubernetes.io/projected/3637481c-8332-45e2-8047-195ca5755b31-kube-api-access-gq2lx\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.479527 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.479383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-service-ca\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.479527 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.479414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-oauth-serving-cert\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.479687 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.479548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-oauth-config\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.479687 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.479600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-serving-cert\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.580098 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.580058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-oauth-serving-cert\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.580530 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.580173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-oauth-config\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.580530 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.580209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-serving-cert\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.580530 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.580246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-console-config\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.580530 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.580274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq2lx\" (UniqueName: \"kubernetes.io/projected/3637481c-8332-45e2-8047-195ca5755b31-kube-api-access-gq2lx\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.580530 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.580300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-service-ca\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.580940 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.580862 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-oauth-serving-cert\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.580940 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.580895 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-service-ca\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.581482 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.581453 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-console-config\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.583731 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.583700 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-oauth-config\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.583842 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.583775 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-serving-cert\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.591326 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.591280 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq2lx\" (UniqueName: \"kubernetes.io/projected/3637481c-8332-45e2-8047-195ca5755b31-kube-api-access-gq2lx\") pod \"console-d545dfd7-s9qwt\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.696690 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.696530 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:07.902948 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.902911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" event={"ID":"f0926b5c-e131-4a5d-8d2d-0fbaf75133da","Type":"ContainerStarted","Data":"eec4b78db4e11c5d970de8890c860d214b3773b596f7f841d2d9d9ff12c4462a"} Sep 18 04:22:07.979909 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:07.979829 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d545dfd7-s9qwt"] Sep 18 04:22:08.302214 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:08.302122 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3637481c_8332_45e2_8047_195ca5755b31.slice/crio-a011adc295c97c432953a00e705a0a9596488c78037ddfe9b7a1d6504ab477f2 WatchSource:0}: Error finding container a011adc295c97c432953a00e705a0a9596488c78037ddfe9b7a1d6504ab477f2: Status 404 returned error can't find the container with id a011adc295c97c432953a00e705a0a9596488c78037ddfe9b7a1d6504ab477f2 Sep 18 04:22:08.909984 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:08.909946 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d545dfd7-s9qwt" event={"ID":"3637481c-8332-45e2-8047-195ca5755b31","Type":"ContainerStarted","Data":"a011adc295c97c432953a00e705a0a9596488c78037ddfe9b7a1d6504ab477f2"} Sep 18 04:22:08.912910 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:08.912877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" event={"ID":"f0926b5c-e131-4a5d-8d2d-0fbaf75133da","Type":"ContainerStarted","Data":"e27166845152eba10d80a4083b537a6055492c5d8969c7379de59711d122d2f5"} Sep 18 04:22:08.913056 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:08.912938 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" event={"ID":"f0926b5c-e131-4a5d-8d2d-0fbaf75133da","Type":"ContainerStarted","Data":"c6718b44db99e5b00e3e48ff2c9c9112352b988e00bfaf16098c4d7e166366e1"} Sep 18 04:22:08.938861 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:08.935501 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kqxxx" podStartSLOduration=2.66725577 podStartE2EDuration="3.93548138s" totalImagesPullingTime="1.26822561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:08.929869269 +0000 UTC m=+66.448540672" watchObservedRunningTime="2026-09-18 04:22:08.93548138 +0000 UTC m=+66.454152772" Sep 18 04:22:10.206486 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.206449 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:22:10.209164 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.209137 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 04:22:10.220290 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.220260 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03823fc1-c5c8-471d-825a-256e029b9bce-metrics-certs\") pod \"network-metrics-daemon-fn5bz\" (UID: \"03823fc1-c5c8-471d-825a-256e029b9bce\") " pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:22:10.307237 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.307205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:22:10.309678 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.309656 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 04:22:10.319722 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.319702 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3fd06a6-c6b4-4f66-9f86-d9857a390bd1-original-pull-secret\") pod \"global-pull-secret-syncer-4fncm\" (UID: \"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1\") " pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:22:10.407788 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.407760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56f68\" (UniqueName: \"kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68\") pod \"network-check-target-rcsd4\" (UID: \"b9773745-b436-43ba-88b7-24316c1c1385\") " pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:22:10.410439 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.410410 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 04:22:10.420374 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.420350 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 04:22:10.432177 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.432148 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56f68\" (UniqueName: \"kubernetes.io/projected/b9773745-b436-43ba-88b7-24316c1c1385-kube-api-access-56f68\") pod \"network-check-target-rcsd4\" (UID: \"b9773745-b436-43ba-88b7-24316c1c1385\") " pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:22:10.465397 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.465323 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2kz7\"" Sep 18 04:22:10.469394 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.469372 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4fncm" Sep 18 04:22:10.473523 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.473503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:22:10.475568 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.475548 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-psk8d\"" Sep 18 04:22:10.484504 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:10.484486 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn5bz" Sep 18 04:22:11.205906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.205873 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml"] Sep 18 04:22:11.208430 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.208408 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.210688 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.210661 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 04:22:11.210806 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.210758 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 04:22:11.211082 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.211066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-26495\"" Sep 18 04:22:11.221044 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.221009 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml"] Sep 18 04:22:11.224100 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.224081 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qkd8p"] Sep 18 04:22:11.226481 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.226452 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.228953 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.228930 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ljq55\"" Sep 18 04:22:11.229069 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.228941 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 04:22:11.229069 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.228992 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 04:22:11.229069 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.229018 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 04:22:11.241924 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.241902 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-jd2b2"] Sep 18 04:22:11.244302 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.244287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.246779 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.246739 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 04:22:11.247158 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.247082 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 04:22:11.247255 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.247213 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k7fqq\"" Sep 18 04:22:11.247395 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.247368 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 04:22:11.258842 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.258820 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-jd2b2"] Sep 18 04:22:11.314275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-textfile\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.314435 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a817bf3c-c990-4a00-8291-015e39207640-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.314435 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.314435 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc485af0-ad6e-4904-b002-33b0fb48b82d-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.314435 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2214f37b-7287-45ad-8662-48eec7d41ba2-sys\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.314641 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2214f37b-7287-45ad-8662-48eec7d41ba2-root\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.314641 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2214f37b-7287-45ad-8662-48eec7d41ba2-metrics-client-ca\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.314641 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.314641 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a817bf3c-c990-4a00-8291-015e39207640-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.314641 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.314641 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-tls\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.314891 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314643 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgk7w\" (UniqueName: \"kubernetes.io/projected/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-api-access-cgk7w\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.314891 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.314891 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314744 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-wtmp\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.314891 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hptsm\" (UniqueName: \"kubernetes.io/projected/a817bf3c-c990-4a00-8291-015e39207640-kube-api-access-hptsm\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.314891 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a817bf3c-c990-4a00-8291-015e39207640-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.314891 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc485af0-ad6e-4904-b002-33b0fb48b82d-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.315157 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314892 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-accelerators-collector-config\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.315157 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.314927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh5qz\" (UniqueName: \"kubernetes.io/projected/2214f37b-7287-45ad-8662-48eec7d41ba2-kube-api-access-sh5qz\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416215 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh5qz\" (UniqueName: \"kubernetes.io/projected/2214f37b-7287-45ad-8662-48eec7d41ba2-kube-api-access-sh5qz\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416215 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-textfile\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416467 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416248 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a817bf3c-c990-4a00-8291-015e39207640-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.416467 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.416467 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc485af0-ad6e-4904-b002-33b0fb48b82d-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.416467 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2214f37b-7287-45ad-8662-48eec7d41ba2-sys\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416467 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2214f37b-7287-45ad-8662-48eec7d41ba2-root\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416467 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416400 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2214f37b-7287-45ad-8662-48eec7d41ba2-root\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416467 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416418 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2214f37b-7287-45ad-8662-48eec7d41ba2-sys\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2214f37b-7287-45ad-8662-48eec7d41ba2-metrics-client-ca\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a817bf3c-c990-4a00-8291-015e39207640-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-tls\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416620 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-textfile\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416656 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgk7w\" (UniqueName: \"kubernetes.io/projected/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-api-access-cgk7w\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-wtmp\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416723 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc485af0-ad6e-4904-b002-33b0fb48b82d-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hptsm\" (UniqueName: \"kubernetes.io/projected/a817bf3c-c990-4a00-8291-015e39207640-kube-api-access-hptsm\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.416793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a817bf3c-c990-4a00-8291-015e39207640-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.417387 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc485af0-ad6e-4904-b002-33b0fb48b82d-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.417387 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.416855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-accelerators-collector-config\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.417387 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.417000 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a817bf3c-c990-4a00-8291-015e39207640-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.417387 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.417359 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2214f37b-7287-45ad-8662-48eec7d41ba2-metrics-client-ca\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.417583 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.417399 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-accelerators-collector-config\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.417583 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:11.416815 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 04:22:11.417583 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:11.417478 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-tls podName:2214f37b-7287-45ad-8662-48eec7d41ba2 nodeName:}" failed. No retries permitted until 2026-09-18 04:22:11.91745924 +0000 UTC m=+69.436130609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-tls") pod "node-exporter-qkd8p" (UID: "2214f37b-7287-45ad-8662-48eec7d41ba2") : secret "node-exporter-tls" not found Sep 18 04:22:11.417744 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:11.417711 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 18 04:22:11.417802 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:11.417764 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a817bf3c-c990-4a00-8291-015e39207640-openshift-state-metrics-tls podName:a817bf3c-c990-4a00-8291-015e39207640 nodeName:}" failed. No retries permitted until 2026-09-18 04:22:11.917747654 +0000 UTC m=+69.436419026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a817bf3c-c990-4a00-8291-015e39207640-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-5qjml" (UID: "a817bf3c-c990-4a00-8291-015e39207640") : secret "openshift-state-metrics-tls" not found Sep 18 04:22:11.417917 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.417884 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-wtmp\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.418070 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.418045 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc485af0-ad6e-4904-b002-33b0fb48b82d-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.418177 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.418095 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.419541 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.419520 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.419659 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.419562 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a817bf3c-c990-4a00-8291-015e39207640-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.420202 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.420177 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.420273 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.420236 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.427589 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.427566 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh5qz\" (UniqueName: \"kubernetes.io/projected/2214f37b-7287-45ad-8662-48eec7d41ba2-kube-api-access-sh5qz\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.428864 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.428844 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgk7w\" (UniqueName: \"kubernetes.io/projected/dc485af0-ad6e-4904-b002-33b0fb48b82d-kube-api-access-cgk7w\") pod \"kube-state-metrics-84c885658c-jd2b2\" (UID: \"dc485af0-ad6e-4904-b002-33b0fb48b82d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.428945 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.428890 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hptsm\" (UniqueName: \"kubernetes.io/projected/a817bf3c-c990-4a00-8291-015e39207640-kube-api-access-hptsm\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.554060 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.553958 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" Sep 18 04:22:11.921671 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.921632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-tls\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:11.921883 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:11.921831 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 04:22:11.921950 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.921836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a817bf3c-c990-4a00-8291-015e39207640-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.921950 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:11.921911 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-tls podName:2214f37b-7287-45ad-8662-48eec7d41ba2 nodeName:}" failed. No retries permitted until 2026-09-18 04:22:12.92188965 +0000 UTC m=+70.440561032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-tls") pod "node-exporter-qkd8p" (UID: "2214f37b-7287-45ad-8662-48eec7d41ba2") : secret "node-exporter-tls" not found Sep 18 04:22:11.924706 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.924674 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a817bf3c-c990-4a00-8291-015e39207640-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5qjml\" (UID: \"a817bf3c-c990-4a00-8291-015e39207640\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:11.980083 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.980048 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67b7986497-6mjch"] Sep 18 04:22:11.982757 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.982728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:11.990461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.990437 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 04:22:11.996311 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:11.996287 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b7986497-6mjch"] Sep 18 04:22:12.022781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.022750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-serving-cert\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.022781 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.022792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-oauth-config\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.022967 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.022817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-config\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.022967 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.022876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-oauth-serving-cert\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.022967 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.022906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-service-ca\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.022967 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.022937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bd2k\" (UniqueName: \"kubernetes.io/projected/d6fd1197-71fb-45d0-9e65-38bf21482e1f-kube-api-access-9bd2k\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.023153 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.022995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-trusted-ca-bundle\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.120160 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.120127 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" Sep 18 04:22:12.123965 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.123942 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-service-ca\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.124114 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.123979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bd2k\" (UniqueName: \"kubernetes.io/projected/d6fd1197-71fb-45d0-9e65-38bf21482e1f-kube-api-access-9bd2k\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.124114 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.124019 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-trusted-ca-bundle\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.124224 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.124162 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-serving-cert\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.124224 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.124204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-oauth-config\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.124322 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.124226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-config\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.124322 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.124277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-oauth-serving-cert\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.124936 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.124908 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-service-ca\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.125070 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.124989 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-oauth-serving-cert\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.125070 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.124991 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-trusted-ca-bundle\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.125279 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.125249 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-config\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.127380 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.127357 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-oauth-config\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.127527 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.127503 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-serving-cert\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.137061 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.137001 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bd2k\" (UniqueName: \"kubernetes.io/projected/d6fd1197-71fb-45d0-9e65-38bf21482e1f-kube-api-access-9bd2k\") pod \"console-67b7986497-6mjch\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.293948 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.293861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:12.320208 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.320182 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 04:22:12.324432 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.324411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.326558 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.326526 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 04:22:12.326719 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.326692 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4grks\"" Sep 18 04:22:12.327073 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.326966 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 04:22:12.327073 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.327065 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 04:22:12.327300 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.327088 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 04:22:12.327433 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.327416 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 04:22:12.327660 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.327641 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 04:22:12.327742 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.327729 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 04:22:12.328084 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.327939 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 04:22:12.328084 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.327973 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 04:22:12.341913 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.341893 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 04:22:12.426288 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426288 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-volume\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426288 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426558 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-web-config\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426558 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426558 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426436 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426558 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426483 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426558 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426809 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426576 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426809 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426809 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426809 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9w56\" (UniqueName: \"kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-kube-api-access-n9w56\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.426809 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.426773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-out\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528083 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528259 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-volume\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528259 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528259 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-web-config\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528259 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528259 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528515 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528515 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528515 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528515 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528515 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528515 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9w56\" (UniqueName: \"kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-kube-api-access-n9w56\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528515 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528473 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-out\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.528860 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:12.528574 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-trusted-ca-bundle podName:dfb9333d-4466-4751-b2ac-bc78d0da6991 nodeName:}" failed. No retries permitted until 2026-09-18 04:22:13.028549147 +0000 UTC m=+70.547220531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991") : configmap references non-existent config key: ca-bundle.crt Sep 18 04:22:12.529009 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.528986 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.529127 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.529108 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.531559 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.531512 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.532138 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.532111 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-volume\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.532138 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.532235 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-web-config\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.532138 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.532320 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-out\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.532646 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.532606 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.532681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.532653 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.532968 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.532943 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.533248 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.533227 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.533824 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.533807 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.539386 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.539349 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9w56\" (UniqueName: \"kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-kube-api-access-n9w56\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:12.931347 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.931314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-tls\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:12.933976 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:12.933948 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2214f37b-7287-45ad-8662-48eec7d41ba2-node-exporter-tls\") pod \"node-exporter-qkd8p\" (UID: \"2214f37b-7287-45ad-8662-48eec7d41ba2\") " pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:13.032416 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.032377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:13.033887 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.033831 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:13.036594 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.036362 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qkd8p" Sep 18 04:22:13.236320 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.236229 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:22:13.245506 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.243756 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-747599d8fb-ww98d"] Sep 18 04:22:13.249611 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.248287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.251277 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.250796 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fkqn4\"" Sep 18 04:22:13.251277 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.251080 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 04:22:13.253821 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.251996 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 04:22:13.253821 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.252213 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-51fmmg72or8sg\"" Sep 18 04:22:13.253821 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.252395 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 04:22:13.253821 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.252577 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 04:22:13.253821 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.253561 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 04:22:13.267265 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.267245 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-747599d8fb-ww98d"] Sep 18 04:22:13.334943 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.334905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-metrics-client-ca\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.335386 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.334956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-tls\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.335386 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.335001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.335386 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.335061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.335386 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.335095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.335386 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.335137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-grpc-tls\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.335386 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.335161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdbm9\" (UniqueName: \"kubernetes.io/projected/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-kube-api-access-jdbm9\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.335386 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.335264 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.436567 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.436532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-metrics-client-ca\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.436760 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.436591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-tls\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.436760 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.436630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.436760 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.436665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.436760 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.436704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.436760 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.436741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-grpc-tls\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.437010 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.436766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdbm9\" (UniqueName: \"kubernetes.io/projected/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-kube-api-access-jdbm9\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.437010 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.436816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.437398 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.437375 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-metrics-client-ca\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.439759 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.439711 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.439911 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.439892 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.440369 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.440325 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.440596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.440571 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.440689 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.440580 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-thanos-querier-tls\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.441589 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.441569 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-secret-grpc-tls\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.445398 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.445373 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdbm9\" (UniqueName: \"kubernetes.io/projected/f6637c31-a9d8-4de4-b639-5f1d6fc140fb-kube-api-access-jdbm9\") pod \"thanos-querier-747599d8fb-ww98d\" (UID: \"f6637c31-a9d8-4de4-b639-5f1d6fc140fb\") " pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.578839 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.578762 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:13.892465 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:13.892436 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xnsv6" Sep 18 04:22:15.852683 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.852645 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6b85cc56d-hrll7"] Sep 18 04:22:15.856318 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.856297 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:15.859456 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.859431 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 04:22:15.859897 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.859873 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 18 04:22:15.860000 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.859882 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pn95t\"" Sep 18 04:22:15.860000 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.859931 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 18 04:22:15.860318 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.860299 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b1e225tembep5\"" Sep 18 04:22:15.860427 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.860330 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 18 04:22:15.869325 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.869304 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b85cc56d-hrll7"] Sep 18 04:22:15.959089 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.959057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/761863a3-fb28-49b2-bcfa-ae3639bba659-client-ca-bundle\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:15.959275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.959097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/761863a3-fb28-49b2-bcfa-ae3639bba659-secret-metrics-server-client-certs\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:15.959275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.959123 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whrn4\" (UniqueName: \"kubernetes.io/projected/761863a3-fb28-49b2-bcfa-ae3639bba659-kube-api-access-whrn4\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:15.959275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.959181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/761863a3-fb28-49b2-bcfa-ae3639bba659-metrics-server-audit-profiles\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:15.959275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.959215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/761863a3-fb28-49b2-bcfa-ae3639bba659-secret-metrics-server-tls\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:15.959275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.959239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/761863a3-fb28-49b2-bcfa-ae3639bba659-audit-log\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:15.959484 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:15.959279 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/761863a3-fb28-49b2-bcfa-ae3639bba659-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.060723 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.060672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/761863a3-fb28-49b2-bcfa-ae3639bba659-secret-metrics-server-tls\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.060723 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.060718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/761863a3-fb28-49b2-bcfa-ae3639bba659-audit-log\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.060962 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.060760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/761863a3-fb28-49b2-bcfa-ae3639bba659-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.060962 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.060843 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/761863a3-fb28-49b2-bcfa-ae3639bba659-client-ca-bundle\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.060962 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.060901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/761863a3-fb28-49b2-bcfa-ae3639bba659-secret-metrics-server-client-certs\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.060962 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.060938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whrn4\" (UniqueName: \"kubernetes.io/projected/761863a3-fb28-49b2-bcfa-ae3639bba659-kube-api-access-whrn4\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.061241 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.060982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/761863a3-fb28-49b2-bcfa-ae3639bba659-metrics-server-audit-profiles\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.061489 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.061439 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/761863a3-fb28-49b2-bcfa-ae3639bba659-audit-log\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.062086 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.062062 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/761863a3-fb28-49b2-bcfa-ae3639bba659-metrics-server-audit-profiles\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.062329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.062304 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/761863a3-fb28-49b2-bcfa-ae3639bba659-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.063837 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.063818 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/761863a3-fb28-49b2-bcfa-ae3639bba659-client-ca-bundle\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.063998 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.063963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/761863a3-fb28-49b2-bcfa-ae3639bba659-secret-metrics-server-tls\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.064122 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.064006 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/761863a3-fb28-49b2-bcfa-ae3639bba659-secret-metrics-server-client-certs\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.077236 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.077216 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-42884"] Sep 18 04:22:16.080183 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.080158 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whrn4\" (UniqueName: \"kubernetes.io/projected/761863a3-fb28-49b2-bcfa-ae3639bba659-kube-api-access-whrn4\") pod \"metrics-server-6b85cc56d-hrll7\" (UID: \"761863a3-fb28-49b2-bcfa-ae3639bba659\") " pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.082914 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.082893 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" Sep 18 04:22:16.088050 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.088012 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tdsw9\"" Sep 18 04:22:16.088148 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.088013 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 04:22:16.105268 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.105217 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-42884"] Sep 18 04:22:16.162186 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.162144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0ba12c3-244d-4f05-9df9-bd5af2b002aa-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-42884\" (UID: \"a0ba12c3-244d-4f05-9df9-bd5af2b002aa\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" Sep 18 04:22:16.162349 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.162213 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwxd8\" (UniqueName: \"kubernetes.io/projected/a0ba12c3-244d-4f05-9df9-bd5af2b002aa-kube-api-access-wwxd8\") pod \"monitoring-plugin-5984459ff8-42884\" (UID: \"a0ba12c3-244d-4f05-9df9-bd5af2b002aa\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" Sep 18 04:22:16.167042 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.166990 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:16.263611 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.263571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwxd8\" (UniqueName: \"kubernetes.io/projected/a0ba12c3-244d-4f05-9df9-bd5af2b002aa-kube-api-access-wwxd8\") pod \"monitoring-plugin-5984459ff8-42884\" (UID: \"a0ba12c3-244d-4f05-9df9-bd5af2b002aa\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" Sep 18 04:22:16.263790 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.263676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0ba12c3-244d-4f05-9df9-bd5af2b002aa-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-42884\" (UID: \"a0ba12c3-244d-4f05-9df9-bd5af2b002aa\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" Sep 18 04:22:16.266480 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.266450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0ba12c3-244d-4f05-9df9-bd5af2b002aa-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-42884\" (UID: \"a0ba12c3-244d-4f05-9df9-bd5af2b002aa\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" Sep 18 04:22:16.274988 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.274963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwxd8\" (UniqueName: \"kubernetes.io/projected/a0ba12c3-244d-4f05-9df9-bd5af2b002aa-kube-api-access-wwxd8\") pod \"monitoring-plugin-5984459ff8-42884\" (UID: \"a0ba12c3-244d-4f05-9df9-bd5af2b002aa\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" Sep 18 04:22:16.397090 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.396994 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" Sep 18 04:22:16.595013 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.594981 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh"] Sep 18 04:22:16.598450 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.598429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.602690 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.602669 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 18 04:22:16.603045 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.603003 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 18 04:22:16.603181 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.603088 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 18 04:22:16.603181 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.603167 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sn29t\"" Sep 18 04:22:16.603643 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.603624 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 18 04:22:16.603888 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.603870 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 18 04:22:16.610070 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.610052 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 18 04:22:16.620475 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.620452 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh"] Sep 18 04:22:16.666901 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.666827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc6k4\" (UniqueName: \"kubernetes.io/projected/728063d1-1b47-4420-82fd-2144311542fd-kube-api-access-pc6k4\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.666901 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.666882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728063d1-1b47-4420-82fd-2144311542fd-serving-certs-ca-bundle\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.667124 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.666970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-secret-telemeter-client\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.667124 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.666990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.667124 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.667020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728063d1-1b47-4420-82fd-2144311542fd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.667124 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.667060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-federate-client-tls\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.667124 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.667095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-telemeter-client-tls\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.667303 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.667160 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728063d1-1b47-4420-82fd-2144311542fd-metrics-client-ca\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.768227 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.768190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-secret-telemeter-client\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.768403 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.768234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.768403 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.768274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728063d1-1b47-4420-82fd-2144311542fd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.768403 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.768302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-federate-client-tls\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.768403 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.768335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-telemeter-client-tls\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.768403 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.768364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728063d1-1b47-4420-82fd-2144311542fd-metrics-client-ca\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.768654 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.768409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc6k4\" (UniqueName: \"kubernetes.io/projected/728063d1-1b47-4420-82fd-2144311542fd-kube-api-access-pc6k4\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.768654 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.768465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728063d1-1b47-4420-82fd-2144311542fd-serving-certs-ca-bundle\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.769392 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.769361 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728063d1-1b47-4420-82fd-2144311542fd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.769528 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.769398 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728063d1-1b47-4420-82fd-2144311542fd-metrics-client-ca\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.769793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.769765 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728063d1-1b47-4420-82fd-2144311542fd-serving-certs-ca-bundle\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.771186 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.771160 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.771329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.771305 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-federate-client-tls\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.771422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.771310 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-telemeter-client-tls\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.771422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.771339 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/728063d1-1b47-4420-82fd-2144311542fd-secret-telemeter-client\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.777579 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.777545 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc6k4\" (UniqueName: \"kubernetes.io/projected/728063d1-1b47-4420-82fd-2144311542fd-kube-api-access-pc6k4\") pod \"telemeter-client-59c7fcd6c8-g4bwh\" (UID: \"728063d1-1b47-4420-82fd-2144311542fd\") " pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:16.909619 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:16.909588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" Sep 18 04:22:17.571486 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.571445 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 04:22:17.575733 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.575709 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.578984 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.578958 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8jhbv\"" Sep 18 04:22:17.579309 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.579285 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 04:22:17.579422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.579312 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 04:22:17.579422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.579332 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 04:22:17.579422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.579337 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 04:22:17.579422 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.579285 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 04:22:17.579638 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.579621 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 04:22:17.579690 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.579644 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 04:22:17.579690 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.579654 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 04:22:17.579998 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.579979 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 04:22:17.580124 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.579980 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 04:22:17.580280 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.580264 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 04:22:17.580416 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.580398 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e2acs0k7gim5a\"" Sep 18 04:22:17.580699 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.580526 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 04:22:17.580699 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.580614 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 04:22:17.583779 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.583761 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 04:22:17.601194 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.601171 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 04:22:17.677122 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677289 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677289 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677289 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677289 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xzdl\" (UniqueName: \"kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-kube-api-access-8xzdl\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-config\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677640 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677640 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677549 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677640 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677640 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677818 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677734 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677818 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677920 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.677920 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677861 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.678002 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.677941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.678070 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.678023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xzdl\" (UniqueName: \"kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-kube-api-access-8xzdl\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-config\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.779816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.780719 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.780719 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.780719 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.780719 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.779989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.782292 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.782025 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.783061 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.782772 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.784132 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.783700 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.784856 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.784630 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.785552 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.785503 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.786727 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.786232 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.786864 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.786046 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.790297 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.789217 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.790297 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.789637 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.790297 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.790252 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.791209 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.791150 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xzdl\" (UniqueName: \"kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-kube-api-access-8xzdl\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.791692 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.791400 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.791692 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.791650 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.791887 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.791864 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.793555 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.793535 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.793936 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.793894 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-config\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.795742 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.795703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.796087 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.796065 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.796837 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.796810 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.797442 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.797405 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:17.888301 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:17.888226 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:18.037973 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:18.037879 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-jd2b2"] Sep 18 04:22:18.529423 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:18.529362 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc485af0_ad6e_4904_b002_33b0fb48b82d.slice/crio-c7a3e69fd6c5b86cfaf6d98cd51fd2cb5c2ebf9384683138b3798cc5896da157 WatchSource:0}: Error finding container c7a3e69fd6c5b86cfaf6d98cd51fd2cb5c2ebf9384683138b3798cc5896da157: Status 404 returned error can't find the container with id c7a3e69fd6c5b86cfaf6d98cd51fd2cb5c2ebf9384683138b3798cc5896da157 Sep 18 04:22:18.531333 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:18.531274 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2214f37b_7287_45ad_8662_48eec7d41ba2.slice/crio-c428aa673eb3052e6945168ba8af396fc77fb928f39bb9fb168d5d75ac5797ed WatchSource:0}: Error finding container c428aa673eb3052e6945168ba8af396fc77fb928f39bb9fb168d5d75ac5797ed: Status 404 returned error can't find the container with id c428aa673eb3052e6945168ba8af396fc77fb928f39bb9fb168d5d75ac5797ed Sep 18 04:22:18.810922 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:18.810894 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml"] Sep 18 04:22:18.813153 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:18.813126 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b7986497-6mjch"] Sep 18 04:22:18.820442 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:18.820416 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 04:22:18.821726 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:18.821652 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-42884"] Sep 18 04:22:18.953858 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:18.953819 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkd8p" event={"ID":"2214f37b-7287-45ad-8662-48eec7d41ba2","Type":"ContainerStarted","Data":"c428aa673eb3052e6945168ba8af396fc77fb928f39bb9fb168d5d75ac5797ed"} Sep 18 04:22:18.955233 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:18.955202 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" event={"ID":"dc485af0-ad6e-4904-b002-33b0fb48b82d","Type":"ContainerStarted","Data":"c7a3e69fd6c5b86cfaf6d98cd51fd2cb5c2ebf9384683138b3798cc5896da157"} Sep 18 04:22:19.034464 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.034430 2562 patch_prober.go:28] interesting pod/image-registry-5984d95969-qtdsz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 04:22:19.034635 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.034487 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5984d95969-qtdsz" podUID="de68f5db-4441-4a3d-aa80-b2b200f439ca" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 04:22:19.900780 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.900663 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4fncm"] Sep 18 04:22:19.909152 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:19.909123 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fd06a6_c6b4_4f66_9f86_d9857a390bd1.slice/crio-80f191a294069e55180523a6a169ff19debeb54123f7a1845326766ef9605b27 WatchSource:0}: Error finding container 80f191a294069e55180523a6a169ff19debeb54123f7a1845326766ef9605b27: Status 404 returned error can't find the container with id 80f191a294069e55180523a6a169ff19debeb54123f7a1845326766ef9605b27 Sep 18 04:22:19.910309 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.910285 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fn5bz"] Sep 18 04:22:19.912395 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:19.912368 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03823fc1_c5c8_471d_825a_256e029b9bce.slice/crio-edd79e056109fe153b56489b46f02d8943629e7e8c92dba9c0c92328b7c6eb96 WatchSource:0}: Error finding container edd79e056109fe153b56489b46f02d8943629e7e8c92dba9c0c92328b7c6eb96: Status 404 returned error can't find the container with id edd79e056109fe153b56489b46f02d8943629e7e8c92dba9c0c92328b7c6eb96 Sep 18 04:22:19.921610 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.921588 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rcsd4"] Sep 18 04:22:19.924585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.924565 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b85cc56d-hrll7"] Sep 18 04:22:19.930202 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:19.930154 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761863a3_fb28_49b2_bcfa_ae3639bba659.slice/crio-01dfea60938755c8d265d9ec0fcfe552e2c618774d33151241bf2e08a550d478 WatchSource:0}: Error finding container 01dfea60938755c8d265d9ec0fcfe552e2c618774d33151241bf2e08a550d478: Status 404 returned error can't find the container with id 01dfea60938755c8d265d9ec0fcfe552e2c618774d33151241bf2e08a550d478 Sep 18 04:22:19.965423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.963081 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rcsd4" event={"ID":"b9773745-b436-43ba-88b7-24316c1c1385","Type":"ContainerStarted","Data":"40c40b0664f515425990ab9d1126e8cdba87ccdeab24c4e875a80109d5336910"} Sep 18 04:22:19.965423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.965338 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-747599d8fb-ww98d"] Sep 18 04:22:19.969705 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.969631 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4fncm" event={"ID":"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1","Type":"ContainerStarted","Data":"80f191a294069e55180523a6a169ff19debeb54123f7a1845326766ef9605b27"} Sep 18 04:22:19.970492 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.970430 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh"] Sep 18 04:22:19.972606 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.972557 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" event={"ID":"a0ba12c3-244d-4f05-9df9-bd5af2b002aa","Type":"ContainerStarted","Data":"24b53f7d70511e226926e7f0ba7921ead25282e5a87d44cca28524c8e3f93c62"} Sep 18 04:22:19.975569 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:19.975527 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6637c31_a9d8_4de4_b639_5f1d6fc140fb.slice/crio-6114b7ae168ee84163f1d96276ec58211b65075fa0f89d743bd1ba7a147e3523 WatchSource:0}: Error finding container 6114b7ae168ee84163f1d96276ec58211b65075fa0f89d743bd1ba7a147e3523: Status 404 returned error can't find the container with id 6114b7ae168ee84163f1d96276ec58211b65075fa0f89d743bd1ba7a147e3523 Sep 18 04:22:19.978203 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:19.978173 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728063d1_1b47_4420_82fd_2144311542fd.slice/crio-c744813d363dd84f9294cae89e4cdf41270375d44d20f33ea18a4624ca890db6 WatchSource:0}: Error finding container c744813d363dd84f9294cae89e4cdf41270375d44d20f33ea18a4624ca890db6: Status 404 returned error can't find the container with id c744813d363dd84f9294cae89e4cdf41270375d44d20f33ea18a4624ca890db6 Sep 18 04:22:19.981191 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.979705 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-bf7c2" event={"ID":"546d87b4-faeb-49cc-b512-958f38fb56f7","Type":"ContainerStarted","Data":"b10bb3d410ad154857f13673971863fded9c3b6c5d99649ae2c886ae369cc9be"} Sep 18 04:22:19.981191 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.979927 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-bf7c2" Sep 18 04:22:19.981711 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.981386 2562 patch_prober.go:28] interesting pod/downloads-6594f4c75-bf7c2 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.9:8080/\": dial tcp 10.134.0.9:8080: connect: connection refused" start-of-body= Sep 18 04:22:19.981711 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.981427 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6594f4c75-bf7c2" podUID="546d87b4-faeb-49cc-b512-958f38fb56f7" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.9:8080/\": dial tcp 10.134.0.9:8080: connect: connection refused" Sep 18 04:22:19.981711 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.981624 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerStarted","Data":"d161cc9811e940dec134ed31d569616dcf8d608857a77cb25140ecfb6b9d9e6f"} Sep 18 04:22:19.985958 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.985063 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fn5bz" event={"ID":"03823fc1-c5c8-471d-825a-256e029b9bce","Type":"ContainerStarted","Data":"edd79e056109fe153b56489b46f02d8943629e7e8c92dba9c0c92328b7c6eb96"} Sep 18 04:22:19.987995 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.987707 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" event={"ID":"761863a3-fb28-49b2-bcfa-ae3639bba659","Type":"ContainerStarted","Data":"01dfea60938755c8d265d9ec0fcfe552e2c618774d33151241bf2e08a550d478"} Sep 18 04:22:19.990192 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.990152 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b7986497-6mjch" event={"ID":"d6fd1197-71fb-45d0-9e65-38bf21482e1f","Type":"ContainerStarted","Data":"ed993b51b55f94aded90e5b7a4b1b5d3b4fcb89041e44ad2c3bbfa5f63fee4f0"} Sep 18 04:22:19.992817 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.992791 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" event={"ID":"a817bf3c-c990-4a00-8291-015e39207640","Type":"ContainerStarted","Data":"7853fd238befed5488d9116fd29d3c95ed7ce86064f0c1dfb1cf30d392c8a079"} Sep 18 04:22:19.992906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.992848 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" event={"ID":"a817bf3c-c990-4a00-8291-015e39207640","Type":"ContainerStarted","Data":"8f9cd1b9cecbb14d625be689488abfaca6dd5a93a8fa6335eec8ce6ec4d5b8c3"} Sep 18 04:22:19.992906 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.992879 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" event={"ID":"a817bf3c-c990-4a00-8291-015e39207640","Type":"ContainerStarted","Data":"28c01beb69055a8c6389a19fdc5e7d7dbffa41d78dd710c43bf45b6d5fcb25b6"} Sep 18 04:22:19.995776 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.995695 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d545dfd7-s9qwt" event={"ID":"3637481c-8332-45e2-8047-195ca5755b31","Type":"ContainerStarted","Data":"e99a72efe8f600eb831cf1ba2fe35390c3f94afb7262aa784179a630dac93f78"} Sep 18 04:22:19.999567 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:19.998786 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-bf7c2" podStartSLOduration=1.84323221 podStartE2EDuration="21.998770003s" totalImagesPullingTime="20.155537793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:19.997378492 +0000 UTC m=+77.516049885" watchObservedRunningTime="2026-09-18 04:22:19.998770003 +0000 UTC m=+77.517441397" Sep 18 04:22:20.015427 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:20.015377 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d545dfd7-s9qwt" podStartSLOduration=1.5948505480000001 podStartE2EDuration="13.015358178s" totalImagesPullingTime="11.42050763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:20.013310625 +0000 UTC m=+77.531982050" watchObservedRunningTime="2026-09-18 04:22:20.015358178 +0000 UTC m=+77.534029573" Sep 18 04:22:20.033221 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:20.033095 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 04:22:20.040046 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:22:20.040002 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec62c9ab_e06a_467c_88a2_6c25990d7310.slice/crio-5627503be2f666cd954aec03f6b34edb23a18d0cbed2965f514bf9ad194d69dd WatchSource:0}: Error finding container 5627503be2f666cd954aec03f6b34edb23a18d0cbed2965f514bf9ad194d69dd: Status 404 returned error can't find the container with id 5627503be2f666cd954aec03f6b34edb23a18d0cbed2965f514bf9ad194d69dd Sep 18 04:22:20.383001 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:20.382913 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d545dfd7-s9qwt"] Sep 18 04:22:20.867057 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:20.866397 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5984d95969-qtdsz" Sep 18 04:22:21.009863 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:21.008128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b7986497-6mjch" event={"ID":"d6fd1197-71fb-45d0-9e65-38bf21482e1f","Type":"ContainerStarted","Data":"48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238"} Sep 18 04:22:21.012741 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:21.012603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" event={"ID":"f6637c31-a9d8-4de4-b639-5f1d6fc140fb","Type":"ContainerStarted","Data":"6114b7ae168ee84163f1d96276ec58211b65075fa0f89d743bd1ba7a147e3523"} Sep 18 04:22:21.027385 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:21.027282 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67b7986497-6mjch" podStartSLOduration=9.623880858 podStartE2EDuration="10.027264469s" totalImagesPullingTime="403.383611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:21.027015105 +0000 UTC m=+78.545686513" watchObservedRunningTime="2026-09-18 04:22:21.027264469 +0000 UTC m=+78.545935858" Sep 18 04:22:21.035238 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:21.035120 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" event={"ID":"728063d1-1b47-4420-82fd-2144311542fd","Type":"ContainerStarted","Data":"c744813d363dd84f9294cae89e4cdf41270375d44d20f33ea18a4624ca890db6"} Sep 18 04:22:21.052041 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:21.050450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerStarted","Data":"5627503be2f666cd954aec03f6b34edb23a18d0cbed2965f514bf9ad194d69dd"} Sep 18 04:22:21.064620 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:21.064422 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-bf7c2" Sep 18 04:22:22.294453 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:22.294412 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:22.294948 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:22.294838 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:22.301732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:22.301712 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:23.077233 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:23.077176 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:27.696840 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:27.696796 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:31.381587 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:31.381548 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b7986497-6mjch"] Sep 18 04:22:32.133512 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.132800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" event={"ID":"761863a3-fb28-49b2-bcfa-ae3639bba659","Type":"ContainerStarted","Data":"ad565d1d0fa7437c10f7284cc5f5dca83729f38231358b9a7756f9fcc4ed5930"} Sep 18 04:22:32.137969 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.137911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" event={"ID":"a817bf3c-c990-4a00-8291-015e39207640","Type":"ContainerStarted","Data":"cb5f065bc6d9e880c170cd1e93834f030b63e9e65967b182069da0d39c8128fe"} Sep 18 04:22:32.142081 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.141803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" event={"ID":"f6637c31-a9d8-4de4-b639-5f1d6fc140fb","Type":"ContainerStarted","Data":"3eeb6fcc9795c42a83d815217f3e2ebe00c129df52ce77719a2455416f302ef2"} Sep 18 04:22:32.151725 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.146800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" event={"ID":"728063d1-1b47-4420-82fd-2144311542fd","Type":"ContainerStarted","Data":"8ecb822e696355207d3c6d8f6fca8f562728762b2ba669231e8d101506ed1ad2"} Sep 18 04:22:32.151725 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.151496 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" podStartSLOduration=5.359699816 podStartE2EDuration="17.151479524s" totalImagesPullingTime="11.791779708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:32.15084352 +0000 UTC m=+89.669514932" watchObservedRunningTime="2026-09-18 04:22:32.151479524 +0000 UTC m=+89.670150916" Sep 18 04:22:32.158988 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.158849 2562 generic.go:356] "Generic (PLEG): container finished" podID="2214f37b-7287-45ad-8662-48eec7d41ba2" containerID="bd9ac85d0918d7681766dad1ad5de0c2f02262d433508755dacd50e664caf06d" exitCode=0 Sep 18 04:22:32.158988 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.158919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkd8p" event={"ID":"2214f37b-7287-45ad-8662-48eec7d41ba2","Type":"ContainerDied","Data":"bd9ac85d0918d7681766dad1ad5de0c2f02262d433508755dacd50e664caf06d"} Sep 18 04:22:32.174754 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.166920 2562 generic.go:356] "Generic (PLEG): container finished" podID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerID="d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7" exitCode=0 Sep 18 04:22:32.174754 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.167002 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerDied","Data":"d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7"} Sep 18 04:22:32.176196 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.175896 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5qjml" podStartSLOduration=9.453017075 podStartE2EDuration="21.175877475s" totalImagesPullingTime="11.7228604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:32.174603762 +0000 UTC m=+89.693275170" watchObservedRunningTime="2026-09-18 04:22:32.175877475 +0000 UTC m=+89.694548867" Sep 18 04:22:32.181841 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:32.180782 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" event={"ID":"dc485af0-ad6e-4904-b002-33b0fb48b82d","Type":"ContainerStarted","Data":"8f065e4370561e5cbf6cff49a8c09d482eeba33901f4d8afdd259add7c5ac805"} Sep 18 04:22:33.191292 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.191251 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fn5bz" event={"ID":"03823fc1-c5c8-471d-825a-256e029b9bce","Type":"ContainerStarted","Data":"cba83d7585ebbc39b10adc9b8485eeba85dbbbe746584da460c0f17802853009"} Sep 18 04:22:33.191810 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.191322 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fn5bz" event={"ID":"03823fc1-c5c8-471d-825a-256e029b9bce","Type":"ContainerStarted","Data":"04b615c47c752227fe4cfe0f9bd0e8efc6fc2d4bc541021ef667e1bb662fb5da"} Sep 18 04:22:33.193595 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.193567 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" event={"ID":"f6637c31-a9d8-4de4-b639-5f1d6fc140fb","Type":"ContainerStarted","Data":"7ded42666aaa260f163b7e7dac0e1a7aa1386cdb1d39933fbd90d0c806a1d3dd"} Sep 18 04:22:33.193708 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.193633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" event={"ID":"f6637c31-a9d8-4de4-b639-5f1d6fc140fb","Type":"ContainerStarted","Data":"8d50a2569af3d7adf4d50e50bce231bd4631b633a3d5a3c2161660d98f5c1b75"} Sep 18 04:22:33.195962 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.195925 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" event={"ID":"728063d1-1b47-4420-82fd-2144311542fd","Type":"ContainerStarted","Data":"5ac90291087ffdc0775629d20d171c4fc92aebd56e640fe0a84d794bb12f42bb"} Sep 18 04:22:33.196104 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.195984 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" event={"ID":"728063d1-1b47-4420-82fd-2144311542fd","Type":"ContainerStarted","Data":"595cb64a4aaa04cf1c682d25eafa75c78d9ec66def176da83c10c6cdd2ecd9b1"} Sep 18 04:22:33.197735 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.197633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rcsd4" event={"ID":"b9773745-b436-43ba-88b7-24316c1c1385","Type":"ContainerStarted","Data":"dbd084687559d805e4525e16766bc48d076bcf72643a1b29e62cdf228e2ac07a"} Sep 18 04:22:33.197735 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.197691 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:22:33.199376 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.199343 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4fncm" event={"ID":"e3fd06a6-c6b4-4f66-9f86-d9857a390bd1","Type":"ContainerStarted","Data":"0795d9fa8c0d33f5d2334e92d654c23b8805efd990969e934d9d560f9da216a5"} Sep 18 04:22:33.201073 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.201053 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" event={"ID":"a0ba12c3-244d-4f05-9df9-bd5af2b002aa","Type":"ContainerStarted","Data":"40b4742677009c92aeded28a63f241e905484736d7841a5d2e2f4a5b9105f5bd"} Sep 18 04:22:33.201213 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.201185 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" Sep 18 04:22:33.205203 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.205129 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkd8p" event={"ID":"2214f37b-7287-45ad-8662-48eec7d41ba2","Type":"ContainerStarted","Data":"3c3b4fe25263d986ead8c53065eb6d4a69b96630ccd86c13563246348dc43474"} Sep 18 04:22:33.205203 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.205173 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkd8p" event={"ID":"2214f37b-7287-45ad-8662-48eec7d41ba2","Type":"ContainerStarted","Data":"b1c79fba2495ab4fcd101d76a39f5972ce9779ca97d281c40ec0e283f4464c1f"} Sep 18 04:22:33.207381 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.207362 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" Sep 18 04:22:33.208550 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.208527 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" event={"ID":"dc485af0-ad6e-4904-b002-33b0fb48b82d","Type":"ContainerStarted","Data":"b16662d2d6f57d6d390a4a12d16539e2d1d30bee42203f022fca21fe61afe9c2"} Sep 18 04:22:33.208654 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.208578 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" event={"ID":"dc485af0-ad6e-4904-b002-33b0fb48b82d","Type":"ContainerStarted","Data":"c10cfc16f88b1ed915178ac90627f8a8494c7cfc891eb19db78cb02e7b1e3009"} Sep 18 04:22:33.211449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.211201 2562 generic.go:356] "Generic (PLEG): container finished" podID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerID="a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714" exitCode=0 Sep 18 04:22:33.211688 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.211646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerDied","Data":"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714"} Sep 18 04:22:33.237340 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.237285 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-42884" podStartSLOduration=5.119753954 podStartE2EDuration="17.237265805s" totalImagesPullingTime="12.117511851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:33.23677294 +0000 UTC m=+90.755444361" watchObservedRunningTime="2026-09-18 04:22:33.237265805 +0000 UTC m=+90.755937200" Sep 18 04:22:33.237779 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.237740 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fn5bz" podStartSLOduration=77.40703952 podStartE2EDuration="1m29.237729208s" totalImagesPullingTime="11.830689688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:33.214871288 +0000 UTC m=+90.733542705" watchObservedRunningTime="2026-09-18 04:22:33.237729208 +0000 UTC m=+90.756400597" Sep 18 04:22:33.262509 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.262467 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59c7fcd6c8-g4bwh" podStartSLOduration=5.52018457 podStartE2EDuration="17.262452005s" totalImagesPullingTime="11.742267435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:33.260638127 +0000 UTC m=+90.779309564" watchObservedRunningTime="2026-09-18 04:22:33.262452005 +0000 UTC m=+90.781123395" Sep 18 04:22:33.290808 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.290751 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-jd2b2" podStartSLOduration=9.187499315 podStartE2EDuration="22.2907315s" totalImagesPullingTime="13.103232185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:33.290257768 +0000 UTC m=+90.808929180" watchObservedRunningTime="2026-09-18 04:22:33.2907315 +0000 UTC m=+90.809402891" Sep 18 04:22:33.317675 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.317625 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4fncm" podStartSLOduration=77.482161439 podStartE2EDuration="1m29.317609337s" totalImagesPullingTime="11.835447898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:33.317093073 +0000 UTC m=+90.835764490" watchObservedRunningTime="2026-09-18 04:22:33.317609337 +0000 UTC m=+90.836280727" Sep 18 04:22:33.347991 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.347920 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qkd8p" podStartSLOduration=10.951308385 podStartE2EDuration="22.347897278s" totalImagesPullingTime="11.2334084s" totalInitContainerRuntime="163.180493ms" isStatefulPod=true podCreationTimestamp="2026-09-18 04:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:33.345934574 +0000 UTC m=+90.864606005" watchObservedRunningTime="2026-09-18 04:22:33.347897278 +0000 UTC m=+90.866568734" Sep 18 04:22:33.418091 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:33.418025 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rcsd4" podStartSLOduration=77.599673288 podStartE2EDuration="1m29.418006821s" totalImagesPullingTime="11.818333533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:33.415840035 +0000 UTC m=+90.934511453" watchObservedRunningTime="2026-09-18 04:22:33.418006821 +0000 UTC m=+90.936678225" Sep 18 04:22:34.673116 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:34.673060 2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb9333d_4466_4751_b2ac_bc78d0da6991.slice/crio-8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e.scope\": RecentStats: unable to find data in memory cache]" Sep 18 04:22:35.224677 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.224587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" event={"ID":"f6637c31-a9d8-4de4-b639-5f1d6fc140fb","Type":"ContainerStarted","Data":"78a611248e8ecfb5ce0cb993a9e2e05878e0131da862abc0e9846f7f7ed46a37"} Sep 18 04:22:35.224832 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.224786 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:35.224894 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.224853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" event={"ID":"f6637c31-a9d8-4de4-b639-5f1d6fc140fb","Type":"ContainerStarted","Data":"070930ab67f5e9499f9c8314b8df0441f48c647ea73b09392052b50260ac2af8"} Sep 18 04:22:35.224894 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.224889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" event={"ID":"f6637c31-a9d8-4de4-b639-5f1d6fc140fb","Type":"ContainerStarted","Data":"690a84e25daf162517051ccaa6a928972b0b44e555c94b57c4ec7528081a3fe8"} Sep 18 04:22:35.228449 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.228421 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerStarted","Data":"f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9"} Sep 18 04:22:35.228580 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.228496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerStarted","Data":"5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53"} Sep 18 04:22:35.228580 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.228542 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerStarted","Data":"8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e"} Sep 18 04:22:35.228693 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.228580 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerStarted","Data":"2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537"} Sep 18 04:22:35.228693 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.228620 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerStarted","Data":"6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d"} Sep 18 04:22:35.228693 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.228666 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerStarted","Data":"f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d"} Sep 18 04:22:35.305714 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.305657 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" podStartSLOduration=8.73967176 podStartE2EDuration="22.305638057s" totalImagesPullingTime="13.565966297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:35.262938563 +0000 UTC m=+92.781609977" watchObservedRunningTime="2026-09-18 04:22:35.305638057 +0000 UTC m=+92.824309455" Sep 18 04:22:35.305895 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:35.305793 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.29715428 podStartE2EDuration="23.305787048s" totalImagesPullingTime="13.977237582s" totalInitContainerRuntime="31.395186ms" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:35.30417355 +0000 UTC m=+92.822844967" watchObservedRunningTime="2026-09-18 04:22:35.305787048 +0000 UTC m=+92.824458438" Sep 18 04:22:36.167720 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:36.167680 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:36.168173 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:36.167791 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:38.245862 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:38.245835 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerStarted","Data":"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6"} Sep 18 04:22:38.246158 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:38.245902 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerStarted","Data":"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3"} Sep 18 04:22:38.246158 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:38.245932 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerStarted","Data":"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c"} Sep 18 04:22:38.246158 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:38.245956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerStarted","Data":"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca"} Sep 18 04:22:38.246158 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:38.245978 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerStarted","Data":"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17"} Sep 18 04:22:39.260456 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:39.260424 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerStarted","Data":"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3"} Sep 18 04:22:39.291859 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:39.291806 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.248181532 podStartE2EDuration="22.291788619s" totalImagesPullingTime="15.995926032s" totalInitContainerRuntime="47.681055ms" isStatefulPod=false podCreationTimestamp="2026-09-18 04:22:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:39.291152891 +0000 UTC m=+96.809824310" watchObservedRunningTime="2026-09-18 04:22:39.291788619 +0000 UTC m=+96.810460010" Sep 18 04:22:41.239192 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:41.239161 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-747599d8fb-ww98d" Sep 18 04:22:42.889066 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:42.889013 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:22:47.119750 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.119701 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d545dfd7-s9qwt" podUID="3637481c-8332-45e2-8047-195ca5755b31" containerName="console" containerID="cri-o://e99a72efe8f600eb831cf1ba2fe35390c3f94afb7262aa784179a630dac93f78" gracePeriod=15 Sep 18 04:22:47.300911 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.300882 2562 generic.go:356] "Generic (PLEG): container finished" podID="3637481c-8332-45e2-8047-195ca5755b31" containerID="e99a72efe8f600eb831cf1ba2fe35390c3f94afb7262aa784179a630dac93f78" exitCode=0 Sep 18 04:22:47.301075 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.300957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d545dfd7-s9qwt" event={"ID":"3637481c-8332-45e2-8047-195ca5755b31","Type":"ContainerDied","Data":"e99a72efe8f600eb831cf1ba2fe35390c3f94afb7262aa784179a630dac93f78"} Sep 18 04:22:47.405423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.405399 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:47.472859 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.472821 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-serving-cert\") pod \"3637481c-8332-45e2-8047-195ca5755b31\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " Sep 18 04:22:47.473126 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.473107 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-oauth-serving-cert\") pod \"3637481c-8332-45e2-8047-195ca5755b31\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " Sep 18 04:22:47.473270 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.473257 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-console-config\") pod \"3637481c-8332-45e2-8047-195ca5755b31\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " Sep 18 04:22:47.473442 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.473413 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-oauth-config\") pod \"3637481c-8332-45e2-8047-195ca5755b31\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " Sep 18 04:22:47.473549 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.473483 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq2lx\" (UniqueName: \"kubernetes.io/projected/3637481c-8332-45e2-8047-195ca5755b31-kube-api-access-gq2lx\") pod \"3637481c-8332-45e2-8047-195ca5755b31\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " Sep 18 04:22:47.473549 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.473528 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-service-ca\") pod \"3637481c-8332-45e2-8047-195ca5755b31\" (UID: \"3637481c-8332-45e2-8047-195ca5755b31\") " Sep 18 04:22:47.473748 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.473719 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-console-config" (OuterVolumeSpecName: "console-config") pod "3637481c-8332-45e2-8047-195ca5755b31" (UID: "3637481c-8332-45e2-8047-195ca5755b31"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:22:47.474442 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.474416 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-console-config\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:47.474574 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.474485 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-service-ca" (OuterVolumeSpecName: "service-ca") pod "3637481c-8332-45e2-8047-195ca5755b31" (UID: "3637481c-8332-45e2-8047-195ca5755b31"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:22:47.474656 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.474561 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3637481c-8332-45e2-8047-195ca5755b31" (UID: "3637481c-8332-45e2-8047-195ca5755b31"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:22:47.476175 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.476142 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3637481c-8332-45e2-8047-195ca5755b31" (UID: "3637481c-8332-45e2-8047-195ca5755b31"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:22:47.476681 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.476649 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3637481c-8332-45e2-8047-195ca5755b31" (UID: "3637481c-8332-45e2-8047-195ca5755b31"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:22:47.476773 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.476676 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3637481c-8332-45e2-8047-195ca5755b31-kube-api-access-gq2lx" (OuterVolumeSpecName: "kube-api-access-gq2lx") pod "3637481c-8332-45e2-8047-195ca5755b31" (UID: "3637481c-8332-45e2-8047-195ca5755b31"). InnerVolumeSpecName "kube-api-access-gq2lx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:22:47.575402 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.575366 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-oauth-config\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:47.575402 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.575395 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq2lx\" (UniqueName: \"kubernetes.io/projected/3637481c-8332-45e2-8047-195ca5755b31-kube-api-access-gq2lx\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:47.575402 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.575405 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-service-ca\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:47.575402 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.575414 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3637481c-8332-45e2-8047-195ca5755b31-console-serving-cert\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:47.575656 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:47.575422 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3637481c-8332-45e2-8047-195ca5755b31-oauth-serving-cert\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:48.306560 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:48.306532 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d545dfd7-s9qwt" Sep 18 04:22:48.306990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:48.306528 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d545dfd7-s9qwt" event={"ID":"3637481c-8332-45e2-8047-195ca5755b31","Type":"ContainerDied","Data":"a011adc295c97c432953a00e705a0a9596488c78037ddfe9b7a1d6504ab477f2"} Sep 18 04:22:48.306990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:48.306658 2562 scope.go:117] "RemoveContainer" containerID="e99a72efe8f600eb831cf1ba2fe35390c3f94afb7262aa784179a630dac93f78" Sep 18 04:22:48.328666 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:48.328644 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d545dfd7-s9qwt"] Sep 18 04:22:48.334920 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:48.334894 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d545dfd7-s9qwt"] Sep 18 04:22:48.556382 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:48.556351 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3637481c-8332-45e2-8047-195ca5755b31" path="/var/lib/kubelet/pods/3637481c-8332-45e2-8047-195ca5755b31/volumes" Sep 18 04:22:56.172719 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.172688 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:56.176558 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.176538 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6b85cc56d-hrll7" Sep 18 04:22:56.400093 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.400022 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67b7986497-6mjch" podUID="d6fd1197-71fb-45d0-9e65-38bf21482e1f" containerName="console" containerID="cri-o://48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238" gracePeriod=15 Sep 18 04:22:56.688859 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.688829 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:56.754559 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.754482 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-trusted-ca-bundle\") pod \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " Sep 18 04:22:56.754559 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.754521 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-serving-cert\") pod \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " Sep 18 04:22:56.754559 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.754550 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-config\") pod \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " Sep 18 04:22:56.754814 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.754603 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bd2k\" (UniqueName: \"kubernetes.io/projected/d6fd1197-71fb-45d0-9e65-38bf21482e1f-kube-api-access-9bd2k\") pod \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " Sep 18 04:22:56.754814 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.754629 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-oauth-config\") pod \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " Sep 18 04:22:56.754814 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.754650 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-service-ca\") pod \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " Sep 18 04:22:56.754814 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.754736 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-oauth-serving-cert\") pod \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\" (UID: \"d6fd1197-71fb-45d0-9e65-38bf21482e1f\") " Sep 18 04:22:56.754985 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.754904 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-config" (OuterVolumeSpecName: "console-config") pod "d6fd1197-71fb-45d0-9e65-38bf21482e1f" (UID: "d6fd1197-71fb-45d0-9e65-38bf21482e1f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:22:56.754985 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.754955 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d6fd1197-71fb-45d0-9e65-38bf21482e1f" (UID: "d6fd1197-71fb-45d0-9e65-38bf21482e1f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:22:56.755144 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.755014 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-trusted-ca-bundle\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:56.755144 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.755079 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-config\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:56.755343 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.755314 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-service-ca" (OuterVolumeSpecName: "service-ca") pod "d6fd1197-71fb-45d0-9e65-38bf21482e1f" (UID: "d6fd1197-71fb-45d0-9e65-38bf21482e1f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:22:56.755424 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.755349 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d6fd1197-71fb-45d0-9e65-38bf21482e1f" (UID: "d6fd1197-71fb-45d0-9e65-38bf21482e1f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:22:56.756945 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.756921 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6fd1197-71fb-45d0-9e65-38bf21482e1f-kube-api-access-9bd2k" (OuterVolumeSpecName: "kube-api-access-9bd2k") pod "d6fd1197-71fb-45d0-9e65-38bf21482e1f" (UID: "d6fd1197-71fb-45d0-9e65-38bf21482e1f"). InnerVolumeSpecName "kube-api-access-9bd2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:22:56.756945 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.756927 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d6fd1197-71fb-45d0-9e65-38bf21482e1f" (UID: "d6fd1197-71fb-45d0-9e65-38bf21482e1f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:22:56.757161 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.756973 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d6fd1197-71fb-45d0-9e65-38bf21482e1f" (UID: "d6fd1197-71fb-45d0-9e65-38bf21482e1f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:22:56.856024 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.855989 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-oauth-serving-cert\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:56.856024 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.856017 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-serving-cert\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:56.856281 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.856048 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bd2k\" (UniqueName: \"kubernetes.io/projected/d6fd1197-71fb-45d0-9e65-38bf21482e1f-kube-api-access-9bd2k\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:56.856281 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.856063 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6fd1197-71fb-45d0-9e65-38bf21482e1f-console-oauth-config\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:56.856281 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:56.856072 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd1197-71fb-45d0-9e65-38bf21482e1f-service-ca\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:22:57.348124 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:57.348088 2562 generic.go:356] "Generic (PLEG): container finished" podID="d6fd1197-71fb-45d0-9e65-38bf21482e1f" containerID="48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238" exitCode=0 Sep 18 04:22:57.348590 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:57.348138 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b7986497-6mjch" Sep 18 04:22:57.348590 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:57.348148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b7986497-6mjch" event={"ID":"d6fd1197-71fb-45d0-9e65-38bf21482e1f","Type":"ContainerDied","Data":"48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238"} Sep 18 04:22:57.348590 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:57.348190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b7986497-6mjch" event={"ID":"d6fd1197-71fb-45d0-9e65-38bf21482e1f","Type":"ContainerDied","Data":"ed993b51b55f94aded90e5b7a4b1b5d3b4fcb89041e44ad2c3bbfa5f63fee4f0"} Sep 18 04:22:57.348590 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:57.348209 2562 scope.go:117] "RemoveContainer" containerID="48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238" Sep 18 04:22:57.361693 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:57.361666 2562 scope.go:117] "RemoveContainer" containerID="48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238" Sep 18 04:22:57.361983 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:22:57.361961 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238\": container with ID starting with 48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238 not found: ID does not exist" containerID="48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238" Sep 18 04:22:57.362065 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:57.362001 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238"} err="failed to get container status \"48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238\": rpc error: code = NotFound desc = could not find container \"48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238\": container with ID starting with 48b862dc07c98c7c1e5f16fa396b105e2585a24fdd588e08aa2dbf89777c8238 not found: ID does not exist" Sep 18 04:22:57.392939 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:57.392911 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b7986497-6mjch"] Sep 18 04:22:57.405123 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:57.405096 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67b7986497-6mjch"] Sep 18 04:22:58.556529 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:22:58.556495 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6fd1197-71fb-45d0-9e65-38bf21482e1f" path="/var/lib/kubelet/pods/d6fd1197-71fb-45d0-9e65-38bf21482e1f/volumes" Sep 18 04:23:04.235758 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:04.235728 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rcsd4" Sep 18 04:23:17.889020 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:17.888986 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:17.966890 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:17.962499 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:18.453274 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:18.453246 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:31.821689 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:31.821647 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 04:23:31.822227 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:31.822022 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="alertmanager" containerID="cri-o://f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d" gracePeriod=120 Sep 18 04:23:31.822227 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:31.822094 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy-metric" containerID="cri-o://5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53" gracePeriod=120 Sep 18 04:23:31.822227 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:31.822114 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy-web" containerID="cri-o://2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537" gracePeriod=120 Sep 18 04:23:31.822227 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:31.822141 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="prom-label-proxy" containerID="cri-o://f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9" gracePeriod=120 Sep 18 04:23:31.822227 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:31.822173 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="config-reloader" containerID="cri-o://6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d" gracePeriod=120 Sep 18 04:23:31.822464 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:31.822145 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy" containerID="cri-o://8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e" gracePeriod=120 Sep 18 04:23:32.496954 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:32.496915 2562 generic.go:356] "Generic (PLEG): container finished" podID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerID="f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9" exitCode=0 Sep 18 04:23:32.496954 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:32.496945 2562 generic.go:356] "Generic (PLEG): container finished" podID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerID="8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e" exitCode=0 Sep 18 04:23:32.496954 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:32.496952 2562 generic.go:356] "Generic (PLEG): container finished" podID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerID="6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d" exitCode=0 Sep 18 04:23:32.496954 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:32.496959 2562 generic.go:356] "Generic (PLEG): container finished" podID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerID="f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d" exitCode=0 Sep 18 04:23:32.497234 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:32.496982 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerDied","Data":"f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9"} Sep 18 04:23:32.497234 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:32.497099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerDied","Data":"8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e"} Sep 18 04:23:32.497234 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:32.497128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerDied","Data":"6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d"} Sep 18 04:23:32.497234 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:32.497153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerDied","Data":"f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d"} Sep 18 04:23:33.070526 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.070505 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.080587 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080563 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-metrics-client-ca\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.080675 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080599 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.080675 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080623 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-trusted-ca-bundle\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.080675 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080641 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9w56\" (UniqueName: \"kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-kube-api-access-n9w56\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.080675 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080674 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-web\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.080852 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080707 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-out\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.080852 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080746 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-cluster-tls-config\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.080852 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080771 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-main-tls\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.080852 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080809 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-volume\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.080852 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080838 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-web-config\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.081127 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080894 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-tls-assets\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.081127 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080949 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.081127 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.080982 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-main-db\") pod \"dfb9333d-4466-4751-b2ac-bc78d0da6991\" (UID: \"dfb9333d-4466-4751-b2ac-bc78d0da6991\") " Sep 18 04:23:33.081127 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.081106 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:23:33.081367 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.081303 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-metrics-client-ca\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.081814 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.081499 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:23:33.082470 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.082437 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:23:33.084189 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.084154 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-volume" (OuterVolumeSpecName: "config-volume") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:33.084443 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.084306 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-out" (OuterVolumeSpecName: "config-out") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:23:33.084443 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.084416 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:33.084599 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.084524 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:33.084753 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.084726 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:33.084867 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.084774 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-kube-api-access-n9w56" (OuterVolumeSpecName: "kube-api-access-n9w56") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "kube-api-access-n9w56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:23:33.085455 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.085428 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:33.085606 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.085589 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:23:33.088938 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.088915 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:33.096410 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.096387 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-web-config" (OuterVolumeSpecName: "web-config") pod "dfb9333d-4466-4751-b2ac-bc78d0da6991" (UID: "dfb9333d-4466-4751-b2ac-bc78d0da6991"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:33.182088 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.181987 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-volume\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182088 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182013 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-web-config\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182088 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182024 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-tls-assets\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182088 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182051 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182088 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182064 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-main-db\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182088 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182078 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182088 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182091 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfb9333d-4466-4751-b2ac-bc78d0da6991-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182416 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182105 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9w56\" (UniqueName: \"kubernetes.io/projected/dfb9333d-4466-4751-b2ac-bc78d0da6991-kube-api-access-n9w56\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182416 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182117 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182416 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182130 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfb9333d-4466-4751-b2ac-bc78d0da6991-config-out\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182416 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182141 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-cluster-tls-config\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.182416 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.182152 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfb9333d-4466-4751-b2ac-bc78d0da6991-secret-alertmanager-main-tls\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:33.503970 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.503885 2562 generic.go:356] "Generic (PLEG): container finished" podID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerID="5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53" exitCode=0 Sep 18 04:23:33.503970 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.503914 2562 generic.go:356] "Generic (PLEG): container finished" podID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerID="2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537" exitCode=0 Sep 18 04:23:33.503970 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.503953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerDied","Data":"5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53"} Sep 18 04:23:33.504237 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.503958 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.504237 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.504055 2562 scope.go:117] "RemoveContainer" containerID="f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9" Sep 18 04:23:33.504237 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.504026 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerDied","Data":"2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537"} Sep 18 04:23:33.504237 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.504179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfb9333d-4466-4751-b2ac-bc78d0da6991","Type":"ContainerDied","Data":"d161cc9811e940dec134ed31d569616dcf8d608857a77cb25140ecfb6b9d9e6f"} Sep 18 04:23:33.511575 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.511556 2562 scope.go:117] "RemoveContainer" containerID="5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53" Sep 18 04:23:33.518447 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.518427 2562 scope.go:117] "RemoveContainer" containerID="8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e" Sep 18 04:23:33.524732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.524704 2562 scope.go:117] "RemoveContainer" containerID="2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537" Sep 18 04:23:33.531315 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.531294 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 04:23:33.531941 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.531922 2562 scope.go:117] "RemoveContainer" containerID="6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d" Sep 18 04:23:33.539244 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.539221 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 04:23:33.539838 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.539820 2562 scope.go:117] "RemoveContainer" containerID="f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d" Sep 18 04:23:33.546886 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.546868 2562 scope.go:117] "RemoveContainer" containerID="d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7" Sep 18 04:23:33.553503 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.553487 2562 scope.go:117] "RemoveContainer" containerID="f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9" Sep 18 04:23:33.553748 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:33.553728 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9\": container with ID starting with f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9 not found: ID does not exist" containerID="f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9" Sep 18 04:23:33.553792 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.553760 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9"} err="failed to get container status \"f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9\": rpc error: code = NotFound desc = could not find container \"f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9\": container with ID starting with f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9 not found: ID does not exist" Sep 18 04:23:33.553792 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.553778 2562 scope.go:117] "RemoveContainer" containerID="5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53" Sep 18 04:23:33.554009 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:33.553991 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53\": container with ID starting with 5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53 not found: ID does not exist" containerID="5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53" Sep 18 04:23:33.554115 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.554018 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53"} err="failed to get container status \"5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53\": rpc error: code = NotFound desc = could not find container \"5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53\": container with ID starting with 5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53 not found: ID does not exist" Sep 18 04:23:33.554163 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.554121 2562 scope.go:117] "RemoveContainer" containerID="8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e" Sep 18 04:23:33.554392 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:33.554377 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e\": container with ID starting with 8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e not found: ID does not exist" containerID="8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e" Sep 18 04:23:33.554434 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.554398 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e"} err="failed to get container status \"8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e\": rpc error: code = NotFound desc = could not find container \"8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e\": container with ID starting with 8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e not found: ID does not exist" Sep 18 04:23:33.554434 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.554411 2562 scope.go:117] "RemoveContainer" containerID="2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537" Sep 18 04:23:33.554628 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:33.554615 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537\": container with ID starting with 2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537 not found: ID does not exist" containerID="2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537" Sep 18 04:23:33.554663 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.554632 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537"} err="failed to get container status \"2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537\": rpc error: code = NotFound desc = could not find container \"2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537\": container with ID starting with 2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537 not found: ID does not exist" Sep 18 04:23:33.554663 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.554643 2562 scope.go:117] "RemoveContainer" containerID="6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d" Sep 18 04:23:33.554861 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:33.554847 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d\": container with ID starting with 6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d not found: ID does not exist" containerID="6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d" Sep 18 04:23:33.554908 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.554864 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d"} err="failed to get container status \"6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d\": rpc error: code = NotFound desc = could not find container \"6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d\": container with ID starting with 6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d not found: ID does not exist" Sep 18 04:23:33.554908 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.554877 2562 scope.go:117] "RemoveContainer" containerID="f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d" Sep 18 04:23:33.555094 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:33.555078 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d\": container with ID starting with f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d not found: ID does not exist" containerID="f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d" Sep 18 04:23:33.555136 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.555097 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d"} err="failed to get container status \"f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d\": rpc error: code = NotFound desc = could not find container \"f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d\": container with ID starting with f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d not found: ID does not exist" Sep 18 04:23:33.555136 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.555108 2562 scope.go:117] "RemoveContainer" containerID="d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7" Sep 18 04:23:33.555301 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:33.555288 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7\": container with ID starting with d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7 not found: ID does not exist" containerID="d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7" Sep 18 04:23:33.555346 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.555303 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7"} err="failed to get container status \"d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7\": rpc error: code = NotFound desc = could not find container \"d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7\": container with ID starting with d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7 not found: ID does not exist" Sep 18 04:23:33.555346 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.555314 2562 scope.go:117] "RemoveContainer" containerID="f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9" Sep 18 04:23:33.555507 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.555492 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9"} err="failed to get container status \"f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9\": rpc error: code = NotFound desc = could not find container \"f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9\": container with ID starting with f43cce5c9a83373554ce47823efb0674f6136f1849cbd0334e91c2b335510cb9 not found: ID does not exist" Sep 18 04:23:33.555550 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.555508 2562 scope.go:117] "RemoveContainer" containerID="5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53" Sep 18 04:23:33.555689 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.555674 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53"} err="failed to get container status \"5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53\": rpc error: code = NotFound desc = could not find container \"5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53\": container with ID starting with 5f081168062fabecb44fde39a6cbe32354927214d9b5d6ca291fec7ec0092b53 not found: ID does not exist" Sep 18 04:23:33.555731 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.555689 2562 scope.go:117] "RemoveContainer" containerID="8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e" Sep 18 04:23:33.555869 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.555854 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e"} err="failed to get container status \"8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e\": rpc error: code = NotFound desc = could not find container \"8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e\": container with ID starting with 8488bb54d2a28a7589c7b42abe882f67d89da446916e295cb96f076615914b9e not found: ID does not exist" Sep 18 04:23:33.555912 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.555868 2562 scope.go:117] "RemoveContainer" containerID="2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537" Sep 18 04:23:33.556073 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.556057 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537"} err="failed to get container status \"2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537\": rpc error: code = NotFound desc = could not find container \"2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537\": container with ID starting with 2f9c9ad71564e314cb3293276651543d0c0b573d1b6dcf3a8d842cfb7cd22537 not found: ID does not exist" Sep 18 04:23:33.556124 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.556073 2562 scope.go:117] "RemoveContainer" containerID="6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d" Sep 18 04:23:33.556268 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.556252 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d"} err="failed to get container status \"6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d\": rpc error: code = NotFound desc = could not find container \"6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d\": container with ID starting with 6e35a52d8ddbccbfd602e16b446f44363981a092802cf80c7b2b09fc6d2c572d not found: ID does not exist" Sep 18 04:23:33.556312 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.556270 2562 scope.go:117] "RemoveContainer" containerID="f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d" Sep 18 04:23:33.556463 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.556445 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d"} err="failed to get container status \"f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d\": rpc error: code = NotFound desc = could not find container \"f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d\": container with ID starting with f0702f56663edebd453a47aef96a49b9f30b7b2ee34749cbaec0fc81c7846e1d not found: ID does not exist" Sep 18 04:23:33.556502 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.556464 2562 scope.go:117] "RemoveContainer" containerID="d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7" Sep 18 04:23:33.556679 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.556664 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7"} err="failed to get container status \"d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7\": rpc error: code = NotFound desc = could not find container \"d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7\": container with ID starting with d3c8cd446859820d07c1d7bddc0ba66e76065b6a75e38f490f739cb8b327dde7 not found: ID does not exist" Sep 18 04:23:33.580954 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.580929 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 04:23:33.581295 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581270 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy" Sep 18 04:23:33.581295 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581291 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581302 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy-metric" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581312 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy-metric" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581321 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="prom-label-proxy" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581329 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="prom-label-proxy" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581342 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="init-config-reloader" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581351 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="init-config-reloader" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581366 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3637481c-8332-45e2-8047-195ca5755b31" containerName="console" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581376 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3637481c-8332-45e2-8047-195ca5755b31" containerName="console" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581391 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy-web" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581399 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy-web" Sep 18 04:23:33.581423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581423 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="alertmanager" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581431 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="alertmanager" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581447 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="config-reloader" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581455 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="config-reloader" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581465 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6fd1197-71fb-45d0-9e65-38bf21482e1f" containerName="console" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581473 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6fd1197-71fb-45d0-9e65-38bf21482e1f" containerName="console" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581559 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="prom-label-proxy" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581572 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3637481c-8332-45e2-8047-195ca5755b31" containerName="console" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581582 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581592 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6fd1197-71fb-45d0-9e65-38bf21482e1f" containerName="console" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581601 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy-metric" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581611 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="kube-rbac-proxy-web" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581620 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="alertmanager" Sep 18 04:23:33.581816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.581628 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" containerName="config-reloader" Sep 18 04:23:33.588125 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.588106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.593416 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.593394 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 04:23:33.593511 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.593436 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 04:23:33.593658 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.593636 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 04:23:33.593658 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.593648 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 04:23:33.593816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.593703 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 04:23:33.593816 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.593763 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 04:23:33.593902 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.593886 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 04:23:33.594005 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.593991 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4grks\"" Sep 18 04:23:33.594072 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.594051 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 04:23:33.602392 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.602370 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 04:23:33.608858 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.608837 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 04:23:33.686428 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686428 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60efdbef-2140-47c7-966d-3ff3dc2a05a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686632 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60efdbef-2140-47c7-966d-3ff3dc2a05a9-config-out\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686632 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686632 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-web-config\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686632 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686518 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60efdbef-2140-47c7-966d-3ff3dc2a05a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686632 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686541 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/60efdbef-2140-47c7-966d-3ff3dc2a05a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686888 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686888 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686888 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686888 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686888 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60efdbef-2140-47c7-966d-3ff3dc2a05a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.686888 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.686803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cmbj\" (UniqueName: \"kubernetes.io/projected/60efdbef-2140-47c7-966d-3ff3dc2a05a9-kube-api-access-5cmbj\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787611 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787611 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787611 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787611 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787916 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60efdbef-2140-47c7-966d-3ff3dc2a05a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787916 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cmbj\" (UniqueName: \"kubernetes.io/projected/60efdbef-2140-47c7-966d-3ff3dc2a05a9-kube-api-access-5cmbj\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787916 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787720 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787916 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60efdbef-2140-47c7-966d-3ff3dc2a05a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787916 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60efdbef-2140-47c7-966d-3ff3dc2a05a9-config-out\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787916 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787916 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-web-config\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787916 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60efdbef-2140-47c7-966d-3ff3dc2a05a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.787916 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.787896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/60efdbef-2140-47c7-966d-3ff3dc2a05a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.788398 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.788326 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/60efdbef-2140-47c7-966d-3ff3dc2a05a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.788766 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.788742 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60efdbef-2140-47c7-966d-3ff3dc2a05a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.790011 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.789980 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60efdbef-2140-47c7-966d-3ff3dc2a05a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.790769 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.790747 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.790860 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.790839 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.790860 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.790851 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.790978 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.790926 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.790978 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.790925 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.791105 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.790995 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-web-config\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.791105 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.791003 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60efdbef-2140-47c7-966d-3ff3dc2a05a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.792413 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.792393 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60efdbef-2140-47c7-966d-3ff3dc2a05a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.792511 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.792491 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60efdbef-2140-47c7-966d-3ff3dc2a05a9-config-out\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.800567 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.800550 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cmbj\" (UniqueName: \"kubernetes.io/projected/60efdbef-2140-47c7-966d-3ff3dc2a05a9-kube-api-access-5cmbj\") pod \"alertmanager-main-0\" (UID: \"60efdbef-2140-47c7-966d-3ff3dc2a05a9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:33.914257 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:33.914225 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 04:23:34.200214 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:34.200169 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 04:23:34.203902 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:23:34.203873 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60efdbef_2140_47c7_966d_3ff3dc2a05a9.slice/crio-b151eaf6a504557a83a5dec921653b5c387a44f94e29c84d85ebc4d490079d88 WatchSource:0}: Error finding container b151eaf6a504557a83a5dec921653b5c387a44f94e29c84d85ebc4d490079d88: Status 404 returned error can't find the container with id b151eaf6a504557a83a5dec921653b5c387a44f94e29c84d85ebc4d490079d88 Sep 18 04:23:34.510170 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:34.510080 2562 generic.go:356] "Generic (PLEG): container finished" podID="60efdbef-2140-47c7-966d-3ff3dc2a05a9" containerID="9d6b65a601c7b89548ef0f76d88c7d352c98f3397ef156725828d1239be38dd7" exitCode=0 Sep 18 04:23:34.510170 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:34.510132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60efdbef-2140-47c7-966d-3ff3dc2a05a9","Type":"ContainerDied","Data":"9d6b65a601c7b89548ef0f76d88c7d352c98f3397ef156725828d1239be38dd7"} Sep 18 04:23:34.510363 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:34.510213 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60efdbef-2140-47c7-966d-3ff3dc2a05a9","Type":"ContainerStarted","Data":"b151eaf6a504557a83a5dec921653b5c387a44f94e29c84d85ebc4d490079d88"} Sep 18 04:23:34.557721 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:34.557694 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfb9333d-4466-4751-b2ac-bc78d0da6991" path="/var/lib/kubelet/pods/dfb9333d-4466-4751-b2ac-bc78d0da6991/volumes" Sep 18 04:23:35.518974 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:35.518942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60efdbef-2140-47c7-966d-3ff3dc2a05a9","Type":"ContainerStarted","Data":"1453d03da144e507998a48eea97b08d09bd13464809576f0dad0a88f99afd48e"} Sep 18 04:23:35.519450 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:35.519014 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60efdbef-2140-47c7-966d-3ff3dc2a05a9","Type":"ContainerStarted","Data":"822e91724fe8ad8b53778215e6b877af0bd393ec86b2723390dd19247578142b"} Sep 18 04:23:35.519450 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:35.519069 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60efdbef-2140-47c7-966d-3ff3dc2a05a9","Type":"ContainerStarted","Data":"10db67d30cb208680b7ee746a586560e7f8c51a6dd989428cccd31306299a455"} Sep 18 04:23:35.519450 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:35.519101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60efdbef-2140-47c7-966d-3ff3dc2a05a9","Type":"ContainerStarted","Data":"dace55ead96a456d8750d9a595f42334f1e86e9601cab0d1457e1c76446b684c"} Sep 18 04:23:35.519450 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:35.519124 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60efdbef-2140-47c7-966d-3ff3dc2a05a9","Type":"ContainerStarted","Data":"714158397e27989285820522645d084066b7bc7acabe40e624714819e0e2888c"} Sep 18 04:23:35.519450 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:35.519146 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60efdbef-2140-47c7-966d-3ff3dc2a05a9","Type":"ContainerStarted","Data":"36a4ce7c5712a90e8e8109ded7a894360695d540150859975c104d2c7c447f35"} Sep 18 04:23:35.556915 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:35.556843 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5408923789999998 podStartE2EDuration="2.556827123s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.934744ms" isStatefulPod=false podCreationTimestamp="2026-09-18 04:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:23:35.556106334 +0000 UTC m=+153.074777745" watchObservedRunningTime="2026-09-18 04:23:35.556827123 +0000 UTC m=+153.075498516" Sep 18 04:23:36.254870 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.254835 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 04:23:36.255186 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.255154 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="prometheus" containerID="cri-o://8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17" gracePeriod=600 Sep 18 04:23:36.255282 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.255194 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy-thanos" containerID="cri-o://afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3" gracePeriod=600 Sep 18 04:23:36.255282 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.255214 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="thanos-sidecar" containerID="cri-o://e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c" gracePeriod=600 Sep 18 04:23:36.255282 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.255229 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy-web" containerID="cri-o://641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3" gracePeriod=600 Sep 18 04:23:36.255282 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.255166 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy" containerID="cri-o://5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6" gracePeriod=600 Sep 18 04:23:36.255504 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.255371 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="config-reloader" containerID="cri-o://c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca" gracePeriod=600 Sep 18 04:23:36.494951 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.494920 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:36.515415 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515323 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-config-out\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515415 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515364 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-metrics-client-ca\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515415 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515381 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-tls-assets\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515415 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515409 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-grpc-tls\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515741 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515449 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-0\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515741 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515475 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-web-config\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515741 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515499 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-serving-certs-ca-bundle\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515741 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515542 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-1\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515741 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515567 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-trusted-ca-bundle\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515741 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515608 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-config\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515741 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515640 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xzdl\" (UniqueName: \"kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-kube-api-access-8xzdl\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515741 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515666 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.515741 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515712 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-2\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.516275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515748 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.516275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515784 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-db\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.516275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515787 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:23:36.516275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515807 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-kubelet-serving-ca-bundle\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.516275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515833 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-thanos-prometheus-http-client-file\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.516275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515876 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-metrics-client-certs\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.516275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515922 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-tls\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.516275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.515948 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-kube-rbac-proxy\") pod \"ec62c9ab-e06a-467c-88a2-6c25990d7310\" (UID: \"ec62c9ab-e06a-467c-88a2-6c25990d7310\") " Sep 18 04:23:36.516275 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.516246 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:23:36.516732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.516294 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-metrics-client-ca\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.517996 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.517966 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:23:36.518602 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.518427 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-config-out" (OuterVolumeSpecName: "config-out") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:23:36.518602 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.518462 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:23:36.518602 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.518493 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:23:36.519335 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.518913 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:23:36.519335 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.518991 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:23:36.519335 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.519104 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:23:36.519797 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.519766 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:36.520551 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.520522 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:23:36.520830 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.520794 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-config" (OuterVolumeSpecName: "config") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:36.523714 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.523686 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:36.523878 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.523859 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:36.524380 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.524346 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:36.524802 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.524750 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:36.524802 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.524769 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-kube-api-access-8xzdl" (OuterVolumeSpecName: "kube-api-access-8xzdl") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "kube-api-access-8xzdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:23:36.524978 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.524892 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:36.525069 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.525047 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:36.529021 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.528995 2562 generic.go:356] "Generic (PLEG): container finished" podID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerID="afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3" exitCode=0 Sep 18 04:23:36.529021 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529019 2562 generic.go:356] "Generic (PLEG): container finished" podID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerID="5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6" exitCode=0 Sep 18 04:23:36.529182 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529025 2562 generic.go:356] "Generic (PLEG): container finished" podID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerID="641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3" exitCode=0 Sep 18 04:23:36.529182 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529055 2562 generic.go:356] "Generic (PLEG): container finished" podID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerID="e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c" exitCode=0 Sep 18 04:23:36.529182 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529063 2562 generic.go:356] "Generic (PLEG): container finished" podID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerID="c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca" exitCode=0 Sep 18 04:23:36.529182 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529070 2562 generic.go:356] "Generic (PLEG): container finished" podID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerID="8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17" exitCode=0 Sep 18 04:23:36.529182 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529095 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerDied","Data":"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3"} Sep 18 04:23:36.529417 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529224 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerDied","Data":"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6"} Sep 18 04:23:36.529417 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529108 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:36.529417 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529272 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerDied","Data":"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3"} Sep 18 04:23:36.529417 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerDied","Data":"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c"} Sep 18 04:23:36.529417 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529329 2562 scope.go:117] "RemoveContainer" containerID="afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3" Sep 18 04:23:36.529650 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529357 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerDied","Data":"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca"} Sep 18 04:23:36.529650 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerDied","Data":"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17"} Sep 18 04:23:36.529650 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.529536 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec62c9ab-e06a-467c-88a2-6c25990d7310","Type":"ContainerDied","Data":"5627503be2f666cd954aec03f6b34edb23a18d0cbed2965f514bf9ad194d69dd"} Sep 18 04:23:36.546535 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.543592 2562 scope.go:117] "RemoveContainer" containerID="5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6" Sep 18 04:23:36.546535 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.544191 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-web-config" (OuterVolumeSpecName: "web-config") pod "ec62c9ab-e06a-467c-88a2-6c25990d7310" (UID: "ec62c9ab-e06a-467c-88a2-6c25990d7310"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:23:36.554063 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.554011 2562 scope.go:117] "RemoveContainer" containerID="641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3" Sep 18 04:23:36.563966 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.563946 2562 scope.go:117] "RemoveContainer" containerID="e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c" Sep 18 04:23:36.575665 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.575643 2562 scope.go:117] "RemoveContainer" containerID="c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca" Sep 18 04:23:36.584793 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.584770 2562 scope.go:117] "RemoveContainer" containerID="8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17" Sep 18 04:23:36.592826 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.592803 2562 scope.go:117] "RemoveContainer" containerID="a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714" Sep 18 04:23:36.600055 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.600023 2562 scope.go:117] "RemoveContainer" containerID="afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3" Sep 18 04:23:36.600356 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:36.600329 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": container with ID starting with afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3 not found: ID does not exist" containerID="afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3" Sep 18 04:23:36.600450 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.600359 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3"} err="failed to get container status \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": rpc error: code = NotFound desc = could not find container \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": container with ID starting with afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3 not found: ID does not exist" Sep 18 04:23:36.600450 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.600379 2562 scope.go:117] "RemoveContainer" containerID="5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6" Sep 18 04:23:36.600644 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:36.600630 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": container with ID starting with 5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6 not found: ID does not exist" containerID="5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6" Sep 18 04:23:36.600682 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.600647 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6"} err="failed to get container status \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": rpc error: code = NotFound desc = could not find container \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": container with ID starting with 5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6 not found: ID does not exist" Sep 18 04:23:36.600682 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.600662 2562 scope.go:117] "RemoveContainer" containerID="641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3" Sep 18 04:23:36.600899 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:36.600883 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": container with ID starting with 641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3 not found: ID does not exist" containerID="641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3" Sep 18 04:23:36.600951 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.600900 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3"} err="failed to get container status \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": rpc error: code = NotFound desc = could not find container \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": container with ID starting with 641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3 not found: ID does not exist" Sep 18 04:23:36.600951 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.600912 2562 scope.go:117] "RemoveContainer" containerID="e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c" Sep 18 04:23:36.601169 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:36.601152 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": container with ID starting with e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c not found: ID does not exist" containerID="e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c" Sep 18 04:23:36.601217 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.601173 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c"} err="failed to get container status \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": rpc error: code = NotFound desc = could not find container \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": container with ID starting with e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c not found: ID does not exist" Sep 18 04:23:36.601217 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.601184 2562 scope.go:117] "RemoveContainer" containerID="c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca" Sep 18 04:23:36.601448 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:36.601432 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": container with ID starting with c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca not found: ID does not exist" containerID="c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca" Sep 18 04:23:36.601503 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.601450 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca"} err="failed to get container status \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": rpc error: code = NotFound desc = could not find container \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": container with ID starting with c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca not found: ID does not exist" Sep 18 04:23:36.601503 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.601470 2562 scope.go:117] "RemoveContainer" containerID="8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17" Sep 18 04:23:36.601677 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:36.601663 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": container with ID starting with 8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17 not found: ID does not exist" containerID="8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17" Sep 18 04:23:36.601712 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.601680 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17"} err="failed to get container status \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": rpc error: code = NotFound desc = could not find container \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": container with ID starting with 8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17 not found: ID does not exist" Sep 18 04:23:36.601712 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.601703 2562 scope.go:117] "RemoveContainer" containerID="a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714" Sep 18 04:23:36.601923 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:23:36.601903 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": container with ID starting with a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714 not found: ID does not exist" containerID="a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714" Sep 18 04:23:36.601979 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.601924 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714"} err="failed to get container status \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": rpc error: code = NotFound desc = could not find container \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": container with ID starting with a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714 not found: ID does not exist" Sep 18 04:23:36.601979 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.601936 2562 scope.go:117] "RemoveContainer" containerID="afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3" Sep 18 04:23:36.602230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.602213 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3"} err="failed to get container status \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": rpc error: code = NotFound desc = could not find container \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": container with ID starting with afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3 not found: ID does not exist" Sep 18 04:23:36.602230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.602230 2562 scope.go:117] "RemoveContainer" containerID="5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6" Sep 18 04:23:36.602485 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.602465 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6"} err="failed to get container status \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": rpc error: code = NotFound desc = could not find container \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": container with ID starting with 5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6 not found: ID does not exist" Sep 18 04:23:36.602559 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.602487 2562 scope.go:117] "RemoveContainer" containerID="641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3" Sep 18 04:23:36.602724 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.602705 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3"} err="failed to get container status \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": rpc error: code = NotFound desc = could not find container \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": container with ID starting with 641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3 not found: ID does not exist" Sep 18 04:23:36.602771 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.602725 2562 scope.go:117] "RemoveContainer" containerID="e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c" Sep 18 04:23:36.602974 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.602955 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c"} err="failed to get container status \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": rpc error: code = NotFound desc = could not find container \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": container with ID starting with e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c not found: ID does not exist" Sep 18 04:23:36.602974 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.602977 2562 scope.go:117] "RemoveContainer" containerID="c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca" Sep 18 04:23:36.603261 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.603241 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca"} err="failed to get container status \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": rpc error: code = NotFound desc = could not find container \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": container with ID starting with c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca not found: ID does not exist" Sep 18 04:23:36.603318 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.603270 2562 scope.go:117] "RemoveContainer" containerID="8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17" Sep 18 04:23:36.603526 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.603506 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17"} err="failed to get container status \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": rpc error: code = NotFound desc = could not find container \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": container with ID starting with 8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17 not found: ID does not exist" Sep 18 04:23:36.603573 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.603528 2562 scope.go:117] "RemoveContainer" containerID="a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714" Sep 18 04:23:36.603754 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.603734 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714"} err="failed to get container status \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": rpc error: code = NotFound desc = could not find container \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": container with ID starting with a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714 not found: ID does not exist" Sep 18 04:23:36.603828 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.603756 2562 scope.go:117] "RemoveContainer" containerID="afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3" Sep 18 04:23:36.604019 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.604002 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3"} err="failed to get container status \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": rpc error: code = NotFound desc = could not find container \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": container with ID starting with afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3 not found: ID does not exist" Sep 18 04:23:36.604147 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.604020 2562 scope.go:117] "RemoveContainer" containerID="5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6" Sep 18 04:23:36.604337 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.604319 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6"} err="failed to get container status \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": rpc error: code = NotFound desc = could not find container \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": container with ID starting with 5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6 not found: ID does not exist" Sep 18 04:23:36.604416 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.604338 2562 scope.go:117] "RemoveContainer" containerID="641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3" Sep 18 04:23:36.604595 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.604574 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3"} err="failed to get container status \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": rpc error: code = NotFound desc = could not find container \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": container with ID starting with 641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3 not found: ID does not exist" Sep 18 04:23:36.604672 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.604598 2562 scope.go:117] "RemoveContainer" containerID="e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c" Sep 18 04:23:36.604900 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.604882 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c"} err="failed to get container status \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": rpc error: code = NotFound desc = could not find container \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": container with ID starting with e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c not found: ID does not exist" Sep 18 04:23:36.604981 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.604901 2562 scope.go:117] "RemoveContainer" containerID="c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca" Sep 18 04:23:36.605256 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.605236 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca"} err="failed to get container status \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": rpc error: code = NotFound desc = could not find container \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": container with ID starting with c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca not found: ID does not exist" Sep 18 04:23:36.605306 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.605258 2562 scope.go:117] "RemoveContainer" containerID="8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17" Sep 18 04:23:36.605500 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.605483 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17"} err="failed to get container status \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": rpc error: code = NotFound desc = could not find container \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": container with ID starting with 8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17 not found: ID does not exist" Sep 18 04:23:36.605561 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.605502 2562 scope.go:117] "RemoveContainer" containerID="a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714" Sep 18 04:23:36.605721 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.605703 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714"} err="failed to get container status \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": rpc error: code = NotFound desc = could not find container \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": container with ID starting with a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714 not found: ID does not exist" Sep 18 04:23:36.605765 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.605721 2562 scope.go:117] "RemoveContainer" containerID="afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3" Sep 18 04:23:36.605947 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.605926 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3"} err="failed to get container status \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": rpc error: code = NotFound desc = could not find container \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": container with ID starting with afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3 not found: ID does not exist" Sep 18 04:23:36.606010 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.605948 2562 scope.go:117] "RemoveContainer" containerID="5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6" Sep 18 04:23:36.606228 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.606209 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6"} err="failed to get container status \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": rpc error: code = NotFound desc = could not find container \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": container with ID starting with 5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6 not found: ID does not exist" Sep 18 04:23:36.606310 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.606229 2562 scope.go:117] "RemoveContainer" containerID="641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3" Sep 18 04:23:36.606476 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.606459 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3"} err="failed to get container status \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": rpc error: code = NotFound desc = could not find container \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": container with ID starting with 641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3 not found: ID does not exist" Sep 18 04:23:36.606531 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.606476 2562 scope.go:117] "RemoveContainer" containerID="e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c" Sep 18 04:23:36.606703 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.606687 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c"} err="failed to get container status \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": rpc error: code = NotFound desc = could not find container \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": container with ID starting with e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c not found: ID does not exist" Sep 18 04:23:36.606746 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.606703 2562 scope.go:117] "RemoveContainer" containerID="c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca" Sep 18 04:23:36.606940 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.606921 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca"} err="failed to get container status \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": rpc error: code = NotFound desc = could not find container \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": container with ID starting with c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca not found: ID does not exist" Sep 18 04:23:36.606996 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.606941 2562 scope.go:117] "RemoveContainer" containerID="8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17" Sep 18 04:23:36.607180 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.607163 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17"} err="failed to get container status \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": rpc error: code = NotFound desc = could not find container \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": container with ID starting with 8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17 not found: ID does not exist" Sep 18 04:23:36.607229 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.607180 2562 scope.go:117] "RemoveContainer" containerID="a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714" Sep 18 04:23:36.607411 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.607394 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714"} err="failed to get container status \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": rpc error: code = NotFound desc = could not find container \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": container with ID starting with a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714 not found: ID does not exist" Sep 18 04:23:36.607452 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.607411 2562 scope.go:117] "RemoveContainer" containerID="afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3" Sep 18 04:23:36.607662 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.607647 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3"} err="failed to get container status \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": rpc error: code = NotFound desc = could not find container \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": container with ID starting with afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3 not found: ID does not exist" Sep 18 04:23:36.607704 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.607663 2562 scope.go:117] "RemoveContainer" containerID="5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6" Sep 18 04:23:36.607875 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.607859 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6"} err="failed to get container status \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": rpc error: code = NotFound desc = could not find container \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": container with ID starting with 5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6 not found: ID does not exist" Sep 18 04:23:36.607918 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.607876 2562 scope.go:117] "RemoveContainer" containerID="641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3" Sep 18 04:23:36.608103 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.608084 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3"} err="failed to get container status \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": rpc error: code = NotFound desc = could not find container \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": container with ID starting with 641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3 not found: ID does not exist" Sep 18 04:23:36.608156 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.608105 2562 scope.go:117] "RemoveContainer" containerID="e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c" Sep 18 04:23:36.608310 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.608297 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c"} err="failed to get container status \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": rpc error: code = NotFound desc = could not find container \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": container with ID starting with e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c not found: ID does not exist" Sep 18 04:23:36.608347 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.608310 2562 scope.go:117] "RemoveContainer" containerID="c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca" Sep 18 04:23:36.608559 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.608539 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca"} err="failed to get container status \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": rpc error: code = NotFound desc = could not find container \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": container with ID starting with c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca not found: ID does not exist" Sep 18 04:23:36.608614 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.608559 2562 scope.go:117] "RemoveContainer" containerID="8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17" Sep 18 04:23:36.608798 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.608778 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17"} err="failed to get container status \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": rpc error: code = NotFound desc = could not find container \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": container with ID starting with 8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17 not found: ID does not exist" Sep 18 04:23:36.608798 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.608797 2562 scope.go:117] "RemoveContainer" containerID="a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714" Sep 18 04:23:36.609000 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.608983 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714"} err="failed to get container status \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": rpc error: code = NotFound desc = could not find container \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": container with ID starting with a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714 not found: ID does not exist" Sep 18 04:23:36.609000 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.608998 2562 scope.go:117] "RemoveContainer" containerID="afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3" Sep 18 04:23:36.609246 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.609228 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3"} err="failed to get container status \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": rpc error: code = NotFound desc = could not find container \"afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3\": container with ID starting with afe9bc27dd065d3d063e41a327dd9d77e483a9215871e80bb30ebead6cdfe1a3 not found: ID does not exist" Sep 18 04:23:36.609294 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.609246 2562 scope.go:117] "RemoveContainer" containerID="5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6" Sep 18 04:23:36.609478 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.609461 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6"} err="failed to get container status \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": rpc error: code = NotFound desc = could not find container \"5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6\": container with ID starting with 5262cdf320fe138fcc6a6cb7e6f19a6b5ca80228d9ba349027e14465da44b5b6 not found: ID does not exist" Sep 18 04:23:36.609525 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.609478 2562 scope.go:117] "RemoveContainer" containerID="641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3" Sep 18 04:23:36.609668 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.609652 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3"} err="failed to get container status \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": rpc error: code = NotFound desc = could not find container \"641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3\": container with ID starting with 641d4f1097dec56360c4133cb7988d7caac152d15a7d5979c774e62e771b3cf3 not found: ID does not exist" Sep 18 04:23:36.609708 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.609669 2562 scope.go:117] "RemoveContainer" containerID="e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c" Sep 18 04:23:36.609880 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.609864 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c"} err="failed to get container status \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": rpc error: code = NotFound desc = could not find container \"e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c\": container with ID starting with e24864b6ab9175cd1ad64a32769a3819fa068599e79d617064fb49afa83a9d0c not found: ID does not exist" Sep 18 04:23:36.609880 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.609880 2562 scope.go:117] "RemoveContainer" containerID="c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca" Sep 18 04:23:36.610132 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.610107 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca"} err="failed to get container status \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": rpc error: code = NotFound desc = could not find container \"c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca\": container with ID starting with c37ab7b8d1c421004fd5783b018c67f949cf6fca97a5093b8c438b59abfa9dca not found: ID does not exist" Sep 18 04:23:36.610224 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.610134 2562 scope.go:117] "RemoveContainer" containerID="8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17" Sep 18 04:23:36.610393 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.610370 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17"} err="failed to get container status \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": rpc error: code = NotFound desc = could not find container \"8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17\": container with ID starting with 8b3caab6a9e3fea55d86608b97fe6539cfbb2bea7b30432c50c5a1a43c116d17 not found: ID does not exist" Sep 18 04:23:36.610435 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.610403 2562 scope.go:117] "RemoveContainer" containerID="a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714" Sep 18 04:23:36.610633 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.610613 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714"} err="failed to get container status \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": rpc error: code = NotFound desc = could not find container \"a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714\": container with ID starting with a3a13dc8903812b0452fce0805c477803cc0c0ee28af2a31aa065cc40eaf2714 not found: ID does not exist" Sep 18 04:23:36.617580 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617559 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-metrics-client-certs\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617665 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617584 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617665 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617599 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-kube-rbac-proxy\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617665 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617609 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-config-out\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617665 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617618 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-tls-assets\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617665 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617635 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-grpc-tls\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617665 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617649 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617665 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617659 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-web-config\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617665 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617668 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617905 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617678 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617905 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617686 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617905 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617694 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-config\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617905 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617702 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xzdl\" (UniqueName: \"kubernetes.io/projected/ec62c9ab-e06a-467c-88a2-6c25990d7310-kube-api-access-8xzdl\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617905 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617711 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617905 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617720 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617905 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617730 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617905 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617738 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec62c9ab-e06a-467c-88a2-6c25990d7310-prometheus-k8s-db\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617905 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617747 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec62c9ab-e06a-467c-88a2-6c25990d7310-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.617905 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.617755 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec62c9ab-e06a-467c-88a2-6c25990d7310-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:23:36.848486 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.848454 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 04:23:36.859717 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.859693 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 04:23:36.898136 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898104 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 04:23:36.898429 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898415 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="prometheus" Sep 18 04:23:36.898492 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898432 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="prometheus" Sep 18 04:23:36.898492 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898447 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="init-config-reloader" Sep 18 04:23:36.898492 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898454 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="init-config-reloader" Sep 18 04:23:36.898492 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898471 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy-web" Sep 18 04:23:36.898492 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898476 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy-web" Sep 18 04:23:36.898492 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898484 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="thanos-sidecar" Sep 18 04:23:36.898492 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898489 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="thanos-sidecar" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898496 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="config-reloader" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898500 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="config-reloader" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898508 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898513 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898518 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy-thanos" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898523 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy-thanos" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898577 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="prometheus" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898584 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="thanos-sidecar" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898591 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898599 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy-web" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898604 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="kube-rbac-proxy-thanos" Sep 18 04:23:36.898732 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.898610 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" containerName="config-reloader" Sep 18 04:23:36.903656 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.903638 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:36.910368 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.910344 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 04:23:36.910788 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.910769 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 04:23:36.910882 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.910805 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 04:23:36.910948 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.910908 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 04:23:36.910948 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.910910 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 04:23:36.911143 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.911095 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 04:23:36.911190 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.911106 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e2acs0k7gim5a\"" Sep 18 04:23:36.911274 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.911116 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 04:23:36.911274 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.911260 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 04:23:36.911405 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.911286 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 04:23:36.911714 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.911698 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8jhbv\"" Sep 18 04:23:36.911752 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.911718 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 04:23:36.911832 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.911815 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 04:23:36.913921 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.913901 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 04:23:36.916427 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.916408 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 04:23:36.920444 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.920423 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 04:23:36.934602 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:36.934578 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 04:23:37.021444 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021630 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021630 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-web-config\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021630 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021630 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021630 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wpbh\" (UniqueName: \"kubernetes.io/projected/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-kube-api-access-2wpbh\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021849 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021849 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-config-out\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021849 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021849 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021849 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021849 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.021849 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-config\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.022116 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.022116 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.022116 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.022116 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.022116 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.022116 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.021981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.022116 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.022000 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123263 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123263 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-web-config\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123263 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123263 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wpbh\" (UniqueName: \"kubernetes.io/projected/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-kube-api-access-2wpbh\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-config-out\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-config\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.123596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123589 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.124278 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123616 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.124278 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.124278 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.124278 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.124278 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.123900 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.124535 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.124451 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.124658 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.124637 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.126126 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.125488 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.126126 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.125496 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.126308 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.126288 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-config-out\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.126403 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.126378 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-web-config\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.126465 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.126431 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.126557 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.126535 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.127274 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.126954 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.127839 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.127388 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.127839 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.127810 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.128328 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.128302 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-config\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.128633 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.128609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.128965 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.128946 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.128965 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.128958 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.129325 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.129308 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.129468 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.129452 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.132519 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.132502 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wpbh\" (UniqueName: \"kubernetes.io/projected/d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16-kube-api-access-2wpbh\") pod \"prometheus-k8s-0\" (UID: \"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.213648 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.213620 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:23:37.520393 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.520302 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 04:23:37.526943 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:23:37.526906 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70ce311_14eb_4ef3_b46b_f7c8f4e8ba16.slice/crio-82821bd78a64c8ca96cca0228e701fb953991487551daf693031d3d9f1a08980 WatchSource:0}: Error finding container 82821bd78a64c8ca96cca0228e701fb953991487551daf693031d3d9f1a08980: Status 404 returned error can't find the container with id 82821bd78a64c8ca96cca0228e701fb953991487551daf693031d3d9f1a08980 Sep 18 04:23:37.535216 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:37.535188 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16","Type":"ContainerStarted","Data":"82821bd78a64c8ca96cca0228e701fb953991487551daf693031d3d9f1a08980"} Sep 18 04:23:38.542514 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:38.542428 2562 generic.go:356] "Generic (PLEG): container finished" podID="d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16" containerID="b8627c3b7b8978695bf4e770828e4cbf4b5d5c9b8d0a6a8fbcf1ced87f1e5740" exitCode=0 Sep 18 04:23:38.542848 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:38.542513 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16","Type":"ContainerDied","Data":"b8627c3b7b8978695bf4e770828e4cbf4b5d5c9b8d0a6a8fbcf1ced87f1e5740"} Sep 18 04:23:38.558163 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:38.558136 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec62c9ab-e06a-467c-88a2-6c25990d7310" path="/var/lib/kubelet/pods/ec62c9ab-e06a-467c-88a2-6c25990d7310/volumes" Sep 18 04:23:39.549381 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:39.549349 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16","Type":"ContainerStarted","Data":"e7b4d27ba559752e49aa323dd04b1c727212bea2ec3ed0e1f313392d073fa0ad"} Sep 18 04:23:39.549762 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:39.549412 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16","Type":"ContainerStarted","Data":"d30c37c8e2b8c475ee152e0ed8f427f2a89a5379469aeb43acd27f255df36594"} Sep 18 04:23:39.549762 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:39.549442 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16","Type":"ContainerStarted","Data":"c2d8f668c7d906eb76c3d0323961dd2ffb9bcb7eeb95a05b7d1d0deb7c22b77f"} Sep 18 04:23:39.549762 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:39.549470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16","Type":"ContainerStarted","Data":"6bcef6c349f7ee22116a1dcb3eef3ffd18679a6177180a21dc2eadf81a912948"} Sep 18 04:23:39.549762 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:39.549494 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16","Type":"ContainerStarted","Data":"25d395ae60c6b4425b16e29c1a64a2f4c6c5e5880fe15b5bfd73baeb12ae4dd9"} Sep 18 04:23:39.549762 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:39.549518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16","Type":"ContainerStarted","Data":"7bd21752a0ad87b5a977e359d493eb2472c8dbf3cd5eba3b120b529eaedc7981"} Sep 18 04:23:39.588734 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:39.588680 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.570760349 podStartE2EDuration="3.588657745s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.897396ms" isStatefulPod=false podCreationTimestamp="2026-09-18 04:23:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:23:39.588139688 +0000 UTC m=+157.106811105" watchObservedRunningTime="2026-09-18 04:23:39.588657745 +0000 UTC m=+157.107329136" Sep 18 04:23:42.214510 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:23:42.214459 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:24:31.085679 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.085593 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc"] Sep 18 04:24:31.089613 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.089592 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.092097 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.092074 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 04:24:31.092214 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.092166 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 18 04:24:31.092421 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.092402 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 04:24:31.092505 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.092419 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-cqkt5\"" Sep 18 04:24:31.102692 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.102667 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc"] Sep 18 04:24:31.179252 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.179209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpnkv\" (UniqueName: \"kubernetes.io/projected/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-kube-api-access-fpnkv\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.179457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.179258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.179457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.179336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.179457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.179423 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.179626 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.179463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.179626 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.179493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.179626 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.179553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.179626 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.179609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.179785 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.179637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.280897 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.280860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281101 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.280905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281101 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.280931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281101 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.280960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnkv\" (UniqueName: \"kubernetes.io/projected/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-kube-api-access-fpnkv\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281101 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.280991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281101 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.281017 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281379 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.281100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281379 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.281136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281379 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.281167 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281379 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.281340 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281570 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.281378 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281570 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.281504 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281570 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.281535 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.281854 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.281837 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.283336 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.283318 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.283442 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.283338 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.288716 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.288698 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpnkv\" (UniqueName: \"kubernetes.io/projected/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-kube-api-access-fpnkv\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.289116 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.289101 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c099ecb8-f7c2-427f-bbf7-80e93fe7283d-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc\" (UID: \"c099ecb8-f7c2-427f-bbf7-80e93fe7283d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.399009 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.398981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:31.676810 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.676783 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc"] Sep 18 04:24:31.679102 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:24:31.679074 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc099ecb8_f7c2_427f_bbf7_80e93fe7283d.slice/crio-a6ac2e9751cdd479be571698c6a821cc245bba5a39f74a1a822b7d12cd81193c WatchSource:0}: Error finding container a6ac2e9751cdd479be571698c6a821cc245bba5a39f74a1a822b7d12cd81193c: Status 404 returned error can't find the container with id a6ac2e9751cdd479be571698c6a821cc245bba5a39f74a1a822b7d12cd81193c Sep 18 04:24:31.763975 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:31.763938 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" event={"ID":"c099ecb8-f7c2-427f-bbf7-80e93fe7283d","Type":"ContainerStarted","Data":"a6ac2e9751cdd479be571698c6a821cc245bba5a39f74a1a822b7d12cd81193c"} Sep 18 04:24:32.534139 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.534098 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg"] Sep 18 04:24:32.538318 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.538291 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:32.540697 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.540671 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 04:24:32.540802 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.540768 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 04:24:32.541447 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.541426 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zfz28\"" Sep 18 04:24:32.545290 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.545242 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg"] Sep 18 04:24:32.593740 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.593704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvxqs\" (UniqueName: \"kubernetes.io/projected/a2712293-e3e7-4b99-a2c6-b773462a87d2-kube-api-access-vvxqs\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:32.593922 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.593829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:32.593922 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.593852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:32.695329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.695287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:32.695512 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.695341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:32.695585 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.695549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxqs\" (UniqueName: \"kubernetes.io/projected/a2712293-e3e7-4b99-a2c6-b773462a87d2-kube-api-access-vvxqs\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:32.695777 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.695727 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:32.695777 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.695746 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:32.705635 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.705452 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvxqs\" (UniqueName: \"kubernetes.io/projected/a2712293-e3e7-4b99-a2c6-b773462a87d2-kube-api-access-vvxqs\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:32.852428 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:32.852393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:33.140009 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:33.139978 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg"] Sep 18 04:24:33.142233 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:24:33.142202 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2712293_e3e7_4b99_a2c6_b773462a87d2.slice/crio-55bb07be5797f4c243d1574dd9853a0a0a19b90736ee462ee0385bc8e1692a95 WatchSource:0}: Error finding container 55bb07be5797f4c243d1574dd9853a0a0a19b90736ee462ee0385bc8e1692a95: Status 404 returned error can't find the container with id 55bb07be5797f4c243d1574dd9853a0a0a19b90736ee462ee0385bc8e1692a95 Sep 18 04:24:33.776791 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:33.776750 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" event={"ID":"a2712293-e3e7-4b99-a2c6-b773462a87d2","Type":"ContainerStarted","Data":"55bb07be5797f4c243d1574dd9853a0a0a19b90736ee462ee0385bc8e1692a95"} Sep 18 04:24:34.479134 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:34.479085 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:24:34.479263 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:34.479173 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:24:34.479263 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:34.479206 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 04:24:34.787543 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:34.787447 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" event={"ID":"c099ecb8-f7c2-427f-bbf7-80e93fe7283d","Type":"ContainerStarted","Data":"12e2514c572fbd3b322dce537e6c04d1bd9b8c42cb38e71295baee26daef251f"} Sep 18 04:24:34.812334 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:34.812274 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" podStartSLOduration=1.014458983 podStartE2EDuration="3.812253061s" totalImagesPullingTime="2.797794078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:24:34.809643516 +0000 UTC m=+212.328314931" watchObservedRunningTime="2026-09-18 04:24:34.812253061 +0000 UTC m=+212.330924455" Sep 18 04:24:35.399909 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:35.399870 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:35.405384 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:35.405358 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:35.792336 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:35.792250 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:35.793942 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:35.793916 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc" Sep 18 04:24:37.214860 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:37.214824 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:24:37.232208 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:37.232183 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:24:37.823804 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:37.823777 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 04:24:39.813596 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:39.813488 2562 generic.go:356] "Generic (PLEG): container finished" podID="a2712293-e3e7-4b99-a2c6-b773462a87d2" containerID="d1f2b30c26d0a17c6f0af76e172844cee9730a83b21df3976e30a84c193fda6b" exitCode=0 Sep 18 04:24:39.813969 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:39.813586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" event={"ID":"a2712293-e3e7-4b99-a2c6-b773462a87d2","Type":"ContainerDied","Data":"d1f2b30c26d0a17c6f0af76e172844cee9730a83b21df3976e30a84c193fda6b"} Sep 18 04:24:40.819600 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:40.819572 2562 generic.go:356] "Generic (PLEG): container finished" podID="a2712293-e3e7-4b99-a2c6-b773462a87d2" containerID="ce467b8b55906ce8b7ca2b78dc424d4c6b6ae1a658c4759eeb737d4ddc42e7d8" exitCode=0 Sep 18 04:24:40.819887 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:40.819654 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" event={"ID":"a2712293-e3e7-4b99-a2c6-b773462a87d2","Type":"ContainerDied","Data":"ce467b8b55906ce8b7ca2b78dc424d4c6b6ae1a658c4759eeb737d4ddc42e7d8"} Sep 18 04:24:46.848818 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:46.848783 2562 generic.go:356] "Generic (PLEG): container finished" podID="a2712293-e3e7-4b99-a2c6-b773462a87d2" containerID="add5bd40dfd0ff8dc0ddd522d9e7c3298a0201376aa5152fc97464dbc5cf7923" exitCode=0 Sep 18 04:24:46.849290 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:46.848832 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" event={"ID":"a2712293-e3e7-4b99-a2c6-b773462a87d2","Type":"ContainerDied","Data":"add5bd40dfd0ff8dc0ddd522d9e7c3298a0201376aa5152fc97464dbc5cf7923"} Sep 18 04:24:47.974240 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:47.974217 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:48.153008 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.152925 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvxqs\" (UniqueName: \"kubernetes.io/projected/a2712293-e3e7-4b99-a2c6-b773462a87d2-kube-api-access-vvxqs\") pod \"a2712293-e3e7-4b99-a2c6-b773462a87d2\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " Sep 18 04:24:48.153008 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.152993 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-util\") pod \"a2712293-e3e7-4b99-a2c6-b773462a87d2\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " Sep 18 04:24:48.153204 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.153101 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-bundle\") pod \"a2712293-e3e7-4b99-a2c6-b773462a87d2\" (UID: \"a2712293-e3e7-4b99-a2c6-b773462a87d2\") " Sep 18 04:24:48.153556 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.153526 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-bundle" (OuterVolumeSpecName: "bundle") pod "a2712293-e3e7-4b99-a2c6-b773462a87d2" (UID: "a2712293-e3e7-4b99-a2c6-b773462a87d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:48.155241 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.155208 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2712293-e3e7-4b99-a2c6-b773462a87d2-kube-api-access-vvxqs" (OuterVolumeSpecName: "kube-api-access-vvxqs") pod "a2712293-e3e7-4b99-a2c6-b773462a87d2" (UID: "a2712293-e3e7-4b99-a2c6-b773462a87d2"). InnerVolumeSpecName "kube-api-access-vvxqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:24:48.157897 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.157872 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-util" (OuterVolumeSpecName: "util") pod "a2712293-e3e7-4b99-a2c6-b773462a87d2" (UID: "a2712293-e3e7-4b99-a2c6-b773462a87d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:48.253884 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.253834 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-util\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:24:48.253884 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.253877 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2712293-e3e7-4b99-a2c6-b773462a87d2-bundle\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:24:48.253884 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.253887 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvxqs\" (UniqueName: \"kubernetes.io/projected/a2712293-e3e7-4b99-a2c6-b773462a87d2-kube-api-access-vvxqs\") on node \"ip-10-0-132-31.ec2.internal\" DevicePath \"\"" Sep 18 04:24:48.858159 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.858131 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" Sep 18 04:24:48.858159 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.858141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz82dg" event={"ID":"a2712293-e3e7-4b99-a2c6-b773462a87d2","Type":"ContainerDied","Data":"55bb07be5797f4c243d1574dd9853a0a0a19b90736ee462ee0385bc8e1692a95"} Sep 18 04:24:48.858362 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:48.858181 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55bb07be5797f4c243d1574dd9853a0a0a19b90736ee462ee0385bc8e1692a95" Sep 18 04:24:55.893660 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.893625 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r"] Sep 18 04:24:55.898128 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.894893 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2712293-e3e7-4b99-a2c6-b773462a87d2" containerName="pull" Sep 18 04:24:55.898128 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.894924 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2712293-e3e7-4b99-a2c6-b773462a87d2" containerName="pull" Sep 18 04:24:55.898128 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.894951 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2712293-e3e7-4b99-a2c6-b773462a87d2" containerName="util" Sep 18 04:24:55.898128 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.894960 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2712293-e3e7-4b99-a2c6-b773462a87d2" containerName="util" Sep 18 04:24:55.898128 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.894975 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2712293-e3e7-4b99-a2c6-b773462a87d2" containerName="extract" Sep 18 04:24:55.898128 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.894984 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2712293-e3e7-4b99-a2c6-b773462a87d2" containerName="extract" Sep 18 04:24:55.898128 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.895213 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2712293-e3e7-4b99-a2c6-b773462a87d2" containerName="extract" Sep 18 04:24:55.948162 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.948125 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r"] Sep 18 04:24:55.948322 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.948244 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" Sep 18 04:24:55.952188 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.952170 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 04:24:55.952757 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:55.952744 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 04:24:56.127381 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:56.127342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df36a09f-3353-47f3-ba72-6bf340e771b3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-k7r5r\" (UID: \"df36a09f-3353-47f3-ba72-6bf340e771b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" Sep 18 04:24:56.127381 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:56.127387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtqbt\" (UniqueName: \"kubernetes.io/projected/df36a09f-3353-47f3-ba72-6bf340e771b3-kube-api-access-mtqbt\") pod \"cert-manager-cainjector-559cdd8c87-k7r5r\" (UID: \"df36a09f-3353-47f3-ba72-6bf340e771b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" Sep 18 04:24:56.228237 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:56.228162 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df36a09f-3353-47f3-ba72-6bf340e771b3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-k7r5r\" (UID: \"df36a09f-3353-47f3-ba72-6bf340e771b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" Sep 18 04:24:56.228237 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:56.228198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtqbt\" (UniqueName: \"kubernetes.io/projected/df36a09f-3353-47f3-ba72-6bf340e771b3-kube-api-access-mtqbt\") pod \"cert-manager-cainjector-559cdd8c87-k7r5r\" (UID: \"df36a09f-3353-47f3-ba72-6bf340e771b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" Sep 18 04:24:56.236376 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:56.236349 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df36a09f-3353-47f3-ba72-6bf340e771b3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-k7r5r\" (UID: \"df36a09f-3353-47f3-ba72-6bf340e771b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" Sep 18 04:24:56.236500 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:56.236357 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtqbt\" (UniqueName: \"kubernetes.io/projected/df36a09f-3353-47f3-ba72-6bf340e771b3-kube-api-access-mtqbt\") pod \"cert-manager-cainjector-559cdd8c87-k7r5r\" (UID: \"df36a09f-3353-47f3-ba72-6bf340e771b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" Sep 18 04:24:56.274913 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:56.274889 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" Sep 18 04:24:56.563307 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:56.563231 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r"] Sep 18 04:24:56.566365 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:24:56.566332 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf36a09f_3353_47f3_ba72_6bf340e771b3.slice/crio-ac22074e276da4968721cbd474c20b7b43e903f890153aef13769d88c61c0434 WatchSource:0}: Error finding container ac22074e276da4968721cbd474c20b7b43e903f890153aef13769d88c61c0434: Status 404 returned error can't find the container with id ac22074e276da4968721cbd474c20b7b43e903f890153aef13769d88c61c0434 Sep 18 04:24:56.894060 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:24:56.894012 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" event={"ID":"df36a09f-3353-47f3-ba72-6bf340e771b3","Type":"ContainerStarted","Data":"ac22074e276da4968721cbd474c20b7b43e903f890153aef13769d88c61c0434"} Sep 18 04:25:00.914115 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:00.914078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" event={"ID":"df36a09f-3353-47f3-ba72-6bf340e771b3","Type":"ContainerStarted","Data":"cdde13d70e7fe0fda172ad524be569bc4461ca3a550dcc62391849bde36659b7"} Sep 18 04:25:05.679694 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.679499 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7r5r" podStartSLOduration=7.142928865 podStartE2EDuration="10.679478364s" totalImagesPullingTime="3.536549499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:00.934739535 +0000 UTC m=+238.453410925" watchObservedRunningTime="2026-09-18 04:25:05.679478364 +0000 UTC m=+243.198149757" Sep 18 04:25:05.681218 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.681200 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dthhv"] Sep 18 04:25:05.684295 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.684280 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dthhv" Sep 18 04:25:05.689990 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.689963 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rnjqm\"" Sep 18 04:25:05.714149 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.714123 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dthhv"] Sep 18 04:25:05.717632 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.717606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4dc3fca-448e-464c-bf05-634e23be8595-bound-sa-token\") pod \"cert-manager-55b4d954d5-dthhv\" (UID: \"d4dc3fca-448e-464c-bf05-634e23be8595\") " pod="cert-manager/cert-manager-55b4d954d5-dthhv" Sep 18 04:25:05.717763 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.717645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxscp\" (UniqueName: \"kubernetes.io/projected/d4dc3fca-448e-464c-bf05-634e23be8595-kube-api-access-xxscp\") pod \"cert-manager-55b4d954d5-dthhv\" (UID: \"d4dc3fca-448e-464c-bf05-634e23be8595\") " pod="cert-manager/cert-manager-55b4d954d5-dthhv" Sep 18 04:25:05.818260 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.818223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4dc3fca-448e-464c-bf05-634e23be8595-bound-sa-token\") pod \"cert-manager-55b4d954d5-dthhv\" (UID: \"d4dc3fca-448e-464c-bf05-634e23be8595\") " pod="cert-manager/cert-manager-55b4d954d5-dthhv" Sep 18 04:25:05.818260 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.818262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxscp\" (UniqueName: \"kubernetes.io/projected/d4dc3fca-448e-464c-bf05-634e23be8595-kube-api-access-xxscp\") pod \"cert-manager-55b4d954d5-dthhv\" (UID: \"d4dc3fca-448e-464c-bf05-634e23be8595\") " pod="cert-manager/cert-manager-55b4d954d5-dthhv" Sep 18 04:25:05.842348 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.842316 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxscp\" (UniqueName: \"kubernetes.io/projected/d4dc3fca-448e-464c-bf05-634e23be8595-kube-api-access-xxscp\") pod \"cert-manager-55b4d954d5-dthhv\" (UID: \"d4dc3fca-448e-464c-bf05-634e23be8595\") " pod="cert-manager/cert-manager-55b4d954d5-dthhv" Sep 18 04:25:05.842498 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.842406 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4dc3fca-448e-464c-bf05-634e23be8595-bound-sa-token\") pod \"cert-manager-55b4d954d5-dthhv\" (UID: \"d4dc3fca-448e-464c-bf05-634e23be8595\") " pod="cert-manager/cert-manager-55b4d954d5-dthhv" Sep 18 04:25:05.993890 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:05.993810 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dthhv" Sep 18 04:25:06.307296 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:25:06.307262 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4dc3fca_448e_464c_bf05_634e23be8595.slice/crio-7f248abe78039007f90a46ad098f07ef305a83a968e817ce16ef4d82c60b55f9 WatchSource:0}: Error finding container 7f248abe78039007f90a46ad098f07ef305a83a968e817ce16ef4d82c60b55f9: Status 404 returned error can't find the container with id 7f248abe78039007f90a46ad098f07ef305a83a968e817ce16ef4d82c60b55f9 Sep 18 04:25:06.307513 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:06.307490 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dthhv"] Sep 18 04:25:06.945370 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:06.945334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dthhv" event={"ID":"d4dc3fca-448e-464c-bf05-634e23be8595","Type":"ContainerStarted","Data":"58024dfb45f457b36f42fce4f95263e69001739b19bfa8bb0cf007621e704708"} Sep 18 04:25:06.945370 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:06.945378 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dthhv" event={"ID":"d4dc3fca-448e-464c-bf05-634e23be8595","Type":"ContainerStarted","Data":"7f248abe78039007f90a46ad098f07ef305a83a968e817ce16ef4d82c60b55f9"} Sep 18 04:25:06.971709 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:06.971664 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dthhv" podStartSLOduration=1.971647572 podStartE2EDuration="1.971647572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:06.969403745 +0000 UTC m=+244.488075157" watchObservedRunningTime="2026-09-18 04:25:06.971647572 +0000 UTC m=+244.490318963" Sep 18 04:25:07.832688 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.832649 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79"] Sep 18 04:25:07.836072 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.836053 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:07.839241 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.839218 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 18 04:25:07.839372 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.839269 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 04:25:07.839372 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.839334 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 18 04:25:07.840182 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.840160 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 18 04:25:07.840359 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.840246 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 04:25:07.840359 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.840286 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-cx5cv\"" Sep 18 04:25:07.857498 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.857477 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79"] Sep 18 04:25:07.940690 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.940664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5977106-7a8d-41ae-ad0d-66d8bc673743-metrics-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:07.940822 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.940698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5977106-7a8d-41ae-ad0d-66d8bc673743-tmp\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:07.940822 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.940715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5977106-7a8d-41ae-ad0d-66d8bc673743-apiservice-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:07.940822 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.940735 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f5977106-7a8d-41ae-ad0d-66d8bc673743-manifests\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:07.940922 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.940826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5977106-7a8d-41ae-ad0d-66d8bc673743-webhook-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:07.940922 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:07.940846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntx6q\" (UniqueName: \"kubernetes.io/projected/f5977106-7a8d-41ae-ad0d-66d8bc673743-kube-api-access-ntx6q\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.041401 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.041371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5977106-7a8d-41ae-ad0d-66d8bc673743-metrics-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.041861 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.041416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5977106-7a8d-41ae-ad0d-66d8bc673743-tmp\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.041861 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.041440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5977106-7a8d-41ae-ad0d-66d8bc673743-apiservice-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.041861 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.041465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f5977106-7a8d-41ae-ad0d-66d8bc673743-manifests\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.041861 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.041556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5977106-7a8d-41ae-ad0d-66d8bc673743-webhook-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.041861 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.041581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntx6q\" (UniqueName: \"kubernetes.io/projected/f5977106-7a8d-41ae-ad0d-66d8bc673743-kube-api-access-ntx6q\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.042175 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.041879 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f5977106-7a8d-41ae-ad0d-66d8bc673743-manifests\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.045014 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.044371 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5977106-7a8d-41ae-ad0d-66d8bc673743-apiservice-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.045014 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.044632 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5977106-7a8d-41ae-ad0d-66d8bc673743-tmp\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.045014 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.044975 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5977106-7a8d-41ae-ad0d-66d8bc673743-webhook-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.045252 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.045066 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5977106-7a8d-41ae-ad0d-66d8bc673743-metrics-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.057446 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.057425 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntx6q\" (UniqueName: \"kubernetes.io/projected/f5977106-7a8d-41ae-ad0d-66d8bc673743-kube-api-access-ntx6q\") pod \"opendatahub-operator-controller-manager-88fcd4466-9xj79\" (UID: \"f5977106-7a8d-41ae-ad0d-66d8bc673743\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.147686 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.147661 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:08.450337 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.450255 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79"] Sep 18 04:25:08.453826 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:25:08.453798 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5977106_7a8d_41ae_ad0d_66d8bc673743.slice/crio-fdaea60a12b65866df69d5f702635405cb3f2e47206b718b870fd3cf64b0cd53 WatchSource:0}: Error finding container fdaea60a12b65866df69d5f702635405cb3f2e47206b718b870fd3cf64b0cd53: Status 404 returned error can't find the container with id fdaea60a12b65866df69d5f702635405cb3f2e47206b718b870fd3cf64b0cd53 Sep 18 04:25:08.956868 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:08.956832 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" event={"ID":"f5977106-7a8d-41ae-ad0d-66d8bc673743","Type":"ContainerStarted","Data":"fdaea60a12b65866df69d5f702635405cb3f2e47206b718b870fd3cf64b0cd53"} Sep 18 04:25:12.979166 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:12.979136 2562 generic.go:356] "Generic (PLEG): container finished" podID="f5977106-7a8d-41ae-ad0d-66d8bc673743" containerID="b0244e741738d482c6f8fc37b710581981314b6f8cd0e5e624b4153ed9f1a0a8" exitCode=0 Sep 18 04:25:12.979514 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:12.979181 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" event={"ID":"f5977106-7a8d-41ae-ad0d-66d8bc673743","Type":"ContainerDied","Data":"b0244e741738d482c6f8fc37b710581981314b6f8cd0e5e624b4153ed9f1a0a8"} Sep 18 04:25:13.310003 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.309855 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts"] Sep 18 04:25:13.313500 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.313481 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts" Sep 18 04:25:13.315782 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.315759 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 18 04:25:13.315883 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.315798 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 18 04:25:13.316186 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.316170 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 18 04:25:13.316277 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.316188 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-l5rhk\"" Sep 18 04:25:13.326370 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.326349 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts"] Sep 18 04:25:13.394046 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.394007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t695v\" (UniqueName: \"kubernetes.io/projected/23381ff8-5935-4287-9938-de3ee65243de-kube-api-access-t695v\") pod \"dns-operator-controller-manager-7b449b7679-ztjts\" (UID: \"23381ff8-5935-4287-9938-de3ee65243de\") " pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts" Sep 18 04:25:13.494972 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.494945 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t695v\" (UniqueName: \"kubernetes.io/projected/23381ff8-5935-4287-9938-de3ee65243de-kube-api-access-t695v\") pod \"dns-operator-controller-manager-7b449b7679-ztjts\" (UID: \"23381ff8-5935-4287-9938-de3ee65243de\") " pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts" Sep 18 04:25:13.510476 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.510448 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t695v\" (UniqueName: \"kubernetes.io/projected/23381ff8-5935-4287-9938-de3ee65243de-kube-api-access-t695v\") pod \"dns-operator-controller-manager-7b449b7679-ztjts\" (UID: \"23381ff8-5935-4287-9938-de3ee65243de\") " pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts" Sep 18 04:25:13.623162 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.623114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts" Sep 18 04:25:13.946084 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.946044 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts"] Sep 18 04:25:13.948764 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:25:13.948737 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23381ff8_5935_4287_9938_de3ee65243de.slice/crio-0f50541bb730e185610ff29c9993807098b7230533f12d670219f0ccdf3a2c9d WatchSource:0}: Error finding container 0f50541bb730e185610ff29c9993807098b7230533f12d670219f0ccdf3a2c9d: Status 404 returned error can't find the container with id 0f50541bb730e185610ff29c9993807098b7230533f12d670219f0ccdf3a2c9d Sep 18 04:25:13.985561 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.985526 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts" event={"ID":"23381ff8-5935-4287-9938-de3ee65243de","Type":"ContainerStarted","Data":"0f50541bb730e185610ff29c9993807098b7230533f12d670219f0ccdf3a2c9d"} Sep 18 04:25:13.987890 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.987865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" event={"ID":"f5977106-7a8d-41ae-ad0d-66d8bc673743","Type":"ContainerStarted","Data":"22cd7a9fcc2c4330167f7ff9da7670945817179a3c41a386b7e010fabc276eb4"} Sep 18 04:25:13.988139 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:13.988120 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:14.022678 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:14.022606 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" podStartSLOduration=2.256236655 podStartE2EDuration="7.022588543s" totalImagesPullingTime="4.293899786s" totalInitContainerRuntime="472.452102ms" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:14.021348389 +0000 UTC m=+251.540019801" watchObservedRunningTime="2026-09-18 04:25:14.022588543 +0000 UTC m=+251.541259935" Sep 18 04:25:16.006851 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:16.006813 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts" event={"ID":"23381ff8-5935-4287-9938-de3ee65243de","Type":"ContainerStarted","Data":"dc33169970f515bcd37ab0270ba478050abd17a30cd397eec5149659e613e02a"} Sep 18 04:25:16.007256 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:16.006973 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts" Sep 18 04:25:16.033478 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:16.033427 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts" podStartSLOduration=1.495003177 podStartE2EDuration="3.033411622s" totalImagesPullingTime="1.538408445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:16.032733356 +0000 UTC m=+253.551404824" watchObservedRunningTime="2026-09-18 04:25:16.033411622 +0000 UTC m=+253.552083013" Sep 18 04:25:25.002801 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:25.002721 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-9xj79" Sep 18 04:25:27.014730 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.014695 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b449b7679-ztjts" Sep 18 04:25:27.712860 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.712821 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg"] Sep 18 04:25:27.718323 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.718303 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:27.721004 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.720978 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 18 04:25:27.721129 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.721092 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 18 04:25:27.721387 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.721372 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wlr8z\"" Sep 18 04:25:27.726098 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.726079 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg"] Sep 18 04:25:27.824671 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.824638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-pp5sg\" (UID: \"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:27.824671 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.824674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-pp5sg\" (UID: \"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:27.824870 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.824693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq58x\" (UniqueName: \"kubernetes.io/projected/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-kube-api-access-vq58x\") pod \"kuadrant-console-plugin-fbdd4f445-pp5sg\" (UID: \"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:27.925205 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.925172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-pp5sg\" (UID: \"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:27.925205 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.925206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-pp5sg\" (UID: \"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:27.925406 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.925223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq58x\" (UniqueName: \"kubernetes.io/projected/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-kube-api-access-vq58x\") pod \"kuadrant-console-plugin-fbdd4f445-pp5sg\" (UID: \"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:27.925406 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:25:27.925314 2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Sep 18 04:25:27.925406 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:25:27.925403 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-plugin-serving-cert podName:6a36b5f7-f0ae-4580-8c0b-d777b30dedd7 nodeName:}" failed. No retries permitted until 2026-09-18 04:25:28.425383681 +0000 UTC m=+265.944055064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-pp5sg" (UID: "6a36b5f7-f0ae-4580-8c0b-d777b30dedd7") : secret "plugin-serving-cert" not found Sep 18 04:25:27.925826 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.925805 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-pp5sg\" (UID: \"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:27.948928 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:27.948891 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq58x\" (UniqueName: \"kubernetes.io/projected/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-kube-api-access-vq58x\") pod \"kuadrant-console-plugin-fbdd4f445-pp5sg\" (UID: \"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:28.429423 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:28.429388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-pp5sg\" (UID: \"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:28.431787 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:28.431765 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a36b5f7-f0ae-4580-8c0b-d777b30dedd7-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-pp5sg\" (UID: \"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:28.627969 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:28.627931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" Sep 18 04:25:28.917877 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:28.917843 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg"] Sep 18 04:25:28.930813 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:25:28.930787 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a36b5f7_f0ae_4580_8c0b_d777b30dedd7.slice/crio-1060fc2efea6b5ee5efdf2539e0a46e6b49d9b51228a999847e9946b7f507dc3 WatchSource:0}: Error finding container 1060fc2efea6b5ee5efdf2539e0a46e6b49d9b51228a999847e9946b7f507dc3: Status 404 returned error can't find the container with id 1060fc2efea6b5ee5efdf2539e0a46e6b49d9b51228a999847e9946b7f507dc3 Sep 18 04:25:29.069972 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:29.069935 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" event={"ID":"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7","Type":"ContainerStarted","Data":"1060fc2efea6b5ee5efdf2539e0a46e6b49d9b51228a999847e9946b7f507dc3"} Sep 18 04:25:32.734090 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.734052 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-764f5f45b-8fp25"] Sep 18 04:25:32.767476 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.767445 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:32.770121 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.769761 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-764f5f45b-8fp25"] Sep 18 04:25:32.770121 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.769846 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zjr98\"" Sep 18 04:25:32.770336 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.770135 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 18 04:25:32.770336 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.770174 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 18 04:25:32.871400 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.871361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf8nb\" (UniqueName: \"kubernetes.io/projected/a585ab93-b609-4977-bab3-615b2c7ce033-kube-api-access-hf8nb\") pod \"kube-auth-proxy-764f5f45b-8fp25\" (UID: \"a585ab93-b609-4977-bab3-615b2c7ce033\") " pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:32.871578 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.871547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a585ab93-b609-4977-bab3-615b2c7ce033-tls-certs\") pod \"kube-auth-proxy-764f5f45b-8fp25\" (UID: \"a585ab93-b609-4977-bab3-615b2c7ce033\") " pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:32.871652 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.871622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a585ab93-b609-4977-bab3-615b2c7ce033-tmp\") pod \"kube-auth-proxy-764f5f45b-8fp25\" (UID: \"a585ab93-b609-4977-bab3-615b2c7ce033\") " pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:32.972492 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.972455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a585ab93-b609-4977-bab3-615b2c7ce033-tls-certs\") pod \"kube-auth-proxy-764f5f45b-8fp25\" (UID: \"a585ab93-b609-4977-bab3-615b2c7ce033\") " pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:32.972658 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.972501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a585ab93-b609-4977-bab3-615b2c7ce033-tmp\") pod \"kube-auth-proxy-764f5f45b-8fp25\" (UID: \"a585ab93-b609-4977-bab3-615b2c7ce033\") " pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:32.972658 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:25:32.972610 2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 18 04:25:32.972658 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.972619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf8nb\" (UniqueName: \"kubernetes.io/projected/a585ab93-b609-4977-bab3-615b2c7ce033-kube-api-access-hf8nb\") pod \"kube-auth-proxy-764f5f45b-8fp25\" (UID: \"a585ab93-b609-4977-bab3-615b2c7ce033\") " pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:32.972769 ip-10-0-132-31 kubenswrapper[2562]: E0918 04:25:32.972671 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a585ab93-b609-4977-bab3-615b2c7ce033-tls-certs podName:a585ab93-b609-4977-bab3-615b2c7ce033 nodeName:}" failed. No retries permitted until 2026-09-18 04:25:33.472653893 +0000 UTC m=+270.991325262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a585ab93-b609-4977-bab3-615b2c7ce033-tls-certs") pod "kube-auth-proxy-764f5f45b-8fp25" (UID: "a585ab93-b609-4977-bab3-615b2c7ce033") : secret "kube-auth-proxy-tls" not found Sep 18 04:25:32.974724 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:32.974705 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a585ab93-b609-4977-bab3-615b2c7ce033-tmp\") pod \"kube-auth-proxy-764f5f45b-8fp25\" (UID: \"a585ab93-b609-4977-bab3-615b2c7ce033\") " pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:33.022384 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:33.022317 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf8nb\" (UniqueName: \"kubernetes.io/projected/a585ab93-b609-4977-bab3-615b2c7ce033-kube-api-access-hf8nb\") pod \"kube-auth-proxy-764f5f45b-8fp25\" (UID: \"a585ab93-b609-4977-bab3-615b2c7ce033\") " pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:33.477766 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:33.477731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a585ab93-b609-4977-bab3-615b2c7ce033-tls-certs\") pod \"kube-auth-proxy-764f5f45b-8fp25\" (UID: \"a585ab93-b609-4977-bab3-615b2c7ce033\") " pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:33.480140 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:33.480119 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a585ab93-b609-4977-bab3-615b2c7ce033-tls-certs\") pod \"kube-auth-proxy-764f5f45b-8fp25\" (UID: \"a585ab93-b609-4977-bab3-615b2c7ce033\") " pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:33.681376 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:33.681346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" Sep 18 04:25:34.368243 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.368202 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-764f5f45b-8fp25"] Sep 18 04:25:34.374159 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:25:34.374133 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda585ab93_b609_4977_bab3_615b2c7ce033.slice/crio-dc3e78a2c94d997d34ccab6e8ca1af3f63ba839399c82058b0f2f7bcad570390 WatchSource:0}: Error finding container dc3e78a2c94d997d34ccab6e8ca1af3f63ba839399c82058b0f2f7bcad570390: Status 404 returned error can't find the container with id dc3e78a2c94d997d34ccab6e8ca1af3f63ba839399c82058b0f2f7bcad570390 Sep 18 04:25:34.492581 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.492542 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-hxs87"] Sep 18 04:25:34.497230 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.497200 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.503740 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.503699 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-jqjj2\"" Sep 18 04:25:34.503866 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.503723 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 04:25:34.527779 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.527758 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 04:25:34.544745 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.544720 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-hxs87"] Sep 18 04:25:34.561854 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.561823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Sep 18 04:25:34.690535 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.690456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b077fc4-b21d-40b7-8707-4f6982e87867-tmp\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.690535 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.690494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b077fc4-b21d-40b7-8707-4f6982e87867-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.690709 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.690569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct297\" (UniqueName: \"kubernetes.io/projected/2b077fc4-b21d-40b7-8707-4f6982e87867-kube-api-access-ct297\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.690709 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.690597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b077fc4-b21d-40b7-8707-4f6982e87867-manifests\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.791653 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.791622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct297\" (UniqueName: \"kubernetes.io/projected/2b077fc4-b21d-40b7-8707-4f6982e87867-kube-api-access-ct297\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.791832 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.791666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b077fc4-b21d-40b7-8707-4f6982e87867-manifests\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.791832 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.791692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b077fc4-b21d-40b7-8707-4f6982e87867-tmp\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.791832 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.791713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b077fc4-b21d-40b7-8707-4f6982e87867-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.792105 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.792084 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b077fc4-b21d-40b7-8707-4f6982e87867-manifests\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.792198 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.792133 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b077fc4-b21d-40b7-8707-4f6982e87867-tmp\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.792532 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.792516 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b077fc4-b21d-40b7-8707-4f6982e87867-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.813129 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.813103 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct297\" (UniqueName: \"kubernetes.io/projected/2b077fc4-b21d-40b7-8707-4f6982e87867-kube-api-access-ct297\") pod \"kserve-module-controller-manager-54765d59fd-hxs87\" (UID: \"2b077fc4-b21d-40b7-8707-4f6982e87867\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:34.921131 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.921096 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s"] Sep 18 04:25:34.924671 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.924649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:34.935289 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.935265 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 18 04:25:34.944106 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.943758 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Sep 18 04:25:34.955948 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.955919 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 18 04:25:34.956104 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.955993 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-cc86m\"" Sep 18 04:25:34.956104 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.956078 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Sep 18 04:25:34.963386 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.963364 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Sep 18 04:25:34.963656 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.963631 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s"] Sep 18 04:25:34.993538 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.993491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43077d0d-344c-4df7-9645-9990d36f1a13-manager-config\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:34.993715 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.993554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-289cx\" (UniqueName: \"kubernetes.io/projected/43077d0d-344c-4df7-9645-9990d36f1a13-kube-api-access-289cx\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:34.993715 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.993633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43077d0d-344c-4df7-9645-9990d36f1a13-metrics-certs\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:34.993855 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:34.993742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43077d0d-344c-4df7-9645-9990d36f1a13-cert\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:35.101074 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.094273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43077d0d-344c-4df7-9645-9990d36f1a13-manager-config\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:35.101074 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.094316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-289cx\" (UniqueName: \"kubernetes.io/projected/43077d0d-344c-4df7-9645-9990d36f1a13-kube-api-access-289cx\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:35.101074 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.094373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43077d0d-344c-4df7-9645-9990d36f1a13-metrics-certs\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:35.101074 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.094448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43077d0d-344c-4df7-9645-9990d36f1a13-cert\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:35.101074 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.095870 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43077d0d-344c-4df7-9645-9990d36f1a13-manager-config\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:35.107147 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.107101 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43077d0d-344c-4df7-9645-9990d36f1a13-cert\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:35.107325 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.107277 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:35.110627 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.110601 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43077d0d-344c-4df7-9645-9990d36f1a13-metrics-certs\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:35.123250 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.123217 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" event={"ID":"a585ab93-b609-4977-bab3-615b2c7ce033","Type":"ContainerStarted","Data":"dc3e78a2c94d997d34ccab6e8ca1af3f63ba839399c82058b0f2f7bcad570390"} Sep 18 04:25:35.124999 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.124949 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-289cx\" (UniqueName: \"kubernetes.io/projected/43077d0d-344c-4df7-9645-9990d36f1a13-kube-api-access-289cx\") pod \"jobset-controller-manager-88847cdbd-mvp4s\" (UID: \"43077d0d-344c-4df7-9645-9990d36f1a13\") " pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:35.126750 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.126715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" event={"ID":"6a36b5f7-f0ae-4580-8c0b-d777b30dedd7","Type":"ContainerStarted","Data":"00426481279f8d9f4808dd7789381ecddeb9e087aba0cc9d8e327151fad0e250"} Sep 18 04:25:35.235850 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.235550 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:35.420712 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.420646 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-pp5sg" podStartSLOduration=3.236280511 podStartE2EDuration="8.420625278s" totalImagesPullingTime="5.184344767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:35.168694534 +0000 UTC m=+272.687365936" watchObservedRunningTime="2026-09-18 04:25:35.420625278 +0000 UTC m=+272.939296670" Sep 18 04:25:35.422954 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.422911 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-hxs87"] Sep 18 04:25:35.426265 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:25:35.426225 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b077fc4_b21d_40b7_8707_4f6982e87867.slice/crio-61eac3d42a1fa2b4a481536ac7ee0c854520ebaaa008468f01d3a62f2a94f18d WatchSource:0}: Error finding container 61eac3d42a1fa2b4a481536ac7ee0c854520ebaaa008468f01d3a62f2a94f18d: Status 404 returned error can't find the container with id 61eac3d42a1fa2b4a481536ac7ee0c854520ebaaa008468f01d3a62f2a94f18d Sep 18 04:25:35.548304 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:35.548206 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s"] Sep 18 04:25:35.552344 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:25:35.552318 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43077d0d_344c_4df7_9645_9990d36f1a13.slice/crio-97acf2a1cc43b8897f8c20bed3de88c4255537347e6d79d84517675d56b08e3e WatchSource:0}: Error finding container 97acf2a1cc43b8897f8c20bed3de88c4255537347e6d79d84517675d56b08e3e: Status 404 returned error can't find the container with id 97acf2a1cc43b8897f8c20bed3de88c4255537347e6d79d84517675d56b08e3e Sep 18 04:25:36.133845 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:36.133806 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" event={"ID":"43077d0d-344c-4df7-9645-9990d36f1a13","Type":"ContainerStarted","Data":"97acf2a1cc43b8897f8c20bed3de88c4255537347e6d79d84517675d56b08e3e"} Sep 18 04:25:36.135284 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:36.135251 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" event={"ID":"2b077fc4-b21d-40b7-8707-4f6982e87867","Type":"ContainerStarted","Data":"61eac3d42a1fa2b4a481536ac7ee0c854520ebaaa008468f01d3a62f2a94f18d"} Sep 18 04:25:37.143997 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:37.143960 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" event={"ID":"a585ab93-b609-4977-bab3-615b2c7ce033","Type":"ContainerStarted","Data":"f93bbc4af741135d6dc497b33d607da56be520a8db2295342db492ecc48ce5cc"} Sep 18 04:25:37.185285 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:37.185223 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-764f5f45b-8fp25" podStartSLOduration=2.8018647 podStartE2EDuration="5.185202173s" totalImagesPullingTime="2.383337473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:37.181588078 +0000 UTC m=+274.700259495" watchObservedRunningTime="2026-09-18 04:25:37.185202173 +0000 UTC m=+274.703873566" Sep 18 04:25:40.161803 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:40.161765 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" event={"ID":"43077d0d-344c-4df7-9645-9990d36f1a13","Type":"ContainerStarted","Data":"c20200350198a44fbb3039b37b107d06f39f726f5c141fbe1ff9b503a1694853"} Sep 18 04:25:40.162263 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:40.161858 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:25:40.163431 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:40.163414 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" event={"ID":"2b077fc4-b21d-40b7-8707-4f6982e87867","Type":"ContainerStarted","Data":"1c67f47b62418624f35e2eceea7786aa2dfdc1de8f38ed835b5e65a6f60cc055"} Sep 18 04:25:40.163537 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:40.163522 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:25:40.189151 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:40.189098 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" podStartSLOduration=1.8867789510000001 podStartE2EDuration="6.189083047s" totalImagesPullingTime="4.302304096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:40.187828956 +0000 UTC m=+277.706500366" watchObservedRunningTime="2026-09-18 04:25:40.189083047 +0000 UTC m=+277.707754438" Sep 18 04:25:40.213764 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:40.213718 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" podStartSLOduration=1.840758347 podStartE2EDuration="6.213704092s" totalImagesPullingTime="4.372945745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:40.21106247 +0000 UTC m=+277.729733879" watchObservedRunningTime="2026-09-18 04:25:40.213704092 +0000 UTC m=+277.732375485" Sep 18 04:25:51.173339 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:25:51.173310 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-88847cdbd-mvp4s" Sep 18 04:26:01.170022 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:26:01.169994 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-hxs87" Sep 18 04:26:04.435391 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:26:04.435364 2562 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 04:30:00.152770 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:00.152689 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm"] Sep 18 04:30:00.156355 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:00.156339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm" Sep 18 04:30:00.158780 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:00.158755 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmb7t\"" Sep 18 04:30:00.165561 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:00.165545 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm" Sep 18 04:30:00.174541 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:00.174519 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm"] Sep 18 04:30:00.439150 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:00.439127 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm"] Sep 18 04:30:00.441325 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:30:00.441293 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22189a5_175d_449a_8d64_edb2cd1b5e18.slice/crio-5c7e80c1394044359a347fc62d4af71e8f23f8eb9b0b44d1a74aa83c989b0c75 WatchSource:0}: Error finding container 5c7e80c1394044359a347fc62d4af71e8f23f8eb9b0b44d1a74aa83c989b0c75: Status 404 returned error can't find the container with id 5c7e80c1394044359a347fc62d4af71e8f23f8eb9b0b44d1a74aa83c989b0c75 Sep 18 04:30:00.443149 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:00.443133 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 04:30:00.459310 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:00.459279 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm" event={"ID":"e22189a5-175d-449a-8d64-edb2cd1b5e18","Type":"ContainerStarted","Data":"5c7e80c1394044359a347fc62d4af71e8f23f8eb9b0b44d1a74aa83c989b0c75"} Sep 18 04:30:03.477420 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:03.477380 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm" event={"ID":"e22189a5-175d-449a-8d64-edb2cd1b5e18","Type":"ContainerStarted","Data":"6f630a81623a8a4efe80032f2fe052af75af04f44306069e0c47c1b9c47d6a7c"} Sep 18 04:30:03.494329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:03.494238 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm" podStartSLOduration=1.187071187 podStartE2EDuration="3.494221274s" totalImagesPullingTime="2.307150087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:30:03.4937838 +0000 UTC m=+541.012455210" watchObservedRunningTime="2026-09-18 04:30:03.494221274 +0000 UTC m=+541.012892667" Sep 18 04:30:04.484236 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:04.484196 2562 generic.go:356] "Generic (PLEG): container finished" podID="e22189a5-175d-449a-8d64-edb2cd1b5e18" containerID="6f630a81623a8a4efe80032f2fe052af75af04f44306069e0c47c1b9c47d6a7c" exitCode=0 Sep 18 04:30:04.484636 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:04.484283 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm" event={"ID":"e22189a5-175d-449a-8d64-edb2cd1b5e18","Type":"ContainerDied","Data":"6f630a81623a8a4efe80032f2fe052af75af04f44306069e0c47c1b9c47d6a7c"} Sep 18 04:30:05.621586 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:05.621560 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm" Sep 18 04:30:06.494948 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:06.494914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm" event={"ID":"e22189a5-175d-449a-8d64-edb2cd1b5e18","Type":"ContainerDied","Data":"5c7e80c1394044359a347fc62d4af71e8f23f8eb9b0b44d1a74aa83c989b0c75"} Sep 18 04:30:06.494948 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:06.494941 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828430-26nsm" Sep 18 04:30:06.495189 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:30:06.494966 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c7e80c1394044359a347fc62d4af71e8f23f8eb9b0b44d1a74aa83c989b0c75" Sep 18 04:40:58.739974 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:40:58.739920 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-hxs87_2b077fc4-b21d-40b7-8707-4f6982e87867/manager/0.log" Sep 18 04:40:59.705389 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:40:59.705361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29828430-26nsm_e22189a5-175d-449a-8d64-edb2cd1b5e18/cleanup/0.log" Sep 18 04:41:00.748789 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:00.748760 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b449b7679-ztjts_23381ff8-5935-4287-9938-de3ee65243de/manager/0.log" Sep 18 04:41:00.857095 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:00.857067 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-pp5sg_6a36b5f7-f0ae-4580-8c0b-d777b30dedd7/kuadrant-console-plugin/0.log" Sep 18 04:41:01.668766 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:01.668733 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-764f5f45b-8fp25_a585ab93-b609-4977-bab3-615b2c7ce033/kube-auth-proxy/0.log" Sep 18 04:41:02.012467 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:02.012386 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc_c099ecb8-f7c2-427f-bbf7-80e93fe7283d/istio-proxy/0.log" Sep 18 04:41:09.234972 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.234935 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xwfjr/must-gather-wf8vg"] Sep 18 04:41:09.235464 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.235357 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e22189a5-175d-449a-8d64-edb2cd1b5e18" containerName="cleanup" Sep 18 04:41:09.235464 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.235371 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e22189a5-175d-449a-8d64-edb2cd1b5e18" containerName="cleanup" Sep 18 04:41:09.235464 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.235440 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e22189a5-175d-449a-8d64-edb2cd1b5e18" containerName="cleanup" Sep 18 04:41:09.238804 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.238784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xwfjr/must-gather-wf8vg" Sep 18 04:41:09.241104 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.241082 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xwfjr\"/\"kube-root-ca.crt\"" Sep 18 04:41:09.241609 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.241585 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xwfjr\"/\"openshift-service-ca.crt\"" Sep 18 04:41:09.256500 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.256474 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xwfjr/must-gather-wf8vg"] Sep 18 04:41:09.319121 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.319091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2398a4aa-d69d-4dbf-bf9f-4e0df09717b8-must-gather-output\") pod \"must-gather-wf8vg\" (UID: \"2398a4aa-d69d-4dbf-bf9f-4e0df09717b8\") " pod="openshift-must-gather-xwfjr/must-gather-wf8vg" Sep 18 04:41:09.319121 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.319122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f65q5\" (UniqueName: \"kubernetes.io/projected/2398a4aa-d69d-4dbf-bf9f-4e0df09717b8-kube-api-access-f65q5\") pod \"must-gather-wf8vg\" (UID: \"2398a4aa-d69d-4dbf-bf9f-4e0df09717b8\") " pod="openshift-must-gather-xwfjr/must-gather-wf8vg" Sep 18 04:41:09.419695 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.419666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2398a4aa-d69d-4dbf-bf9f-4e0df09717b8-must-gather-output\") pod \"must-gather-wf8vg\" (UID: \"2398a4aa-d69d-4dbf-bf9f-4e0df09717b8\") " pod="openshift-must-gather-xwfjr/must-gather-wf8vg" Sep 18 04:41:09.419801 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.419700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f65q5\" (UniqueName: \"kubernetes.io/projected/2398a4aa-d69d-4dbf-bf9f-4e0df09717b8-kube-api-access-f65q5\") pod \"must-gather-wf8vg\" (UID: \"2398a4aa-d69d-4dbf-bf9f-4e0df09717b8\") " pod="openshift-must-gather-xwfjr/must-gather-wf8vg" Sep 18 04:41:09.420117 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.420101 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2398a4aa-d69d-4dbf-bf9f-4e0df09717b8-must-gather-output\") pod \"must-gather-wf8vg\" (UID: \"2398a4aa-d69d-4dbf-bf9f-4e0df09717b8\") " pod="openshift-must-gather-xwfjr/must-gather-wf8vg" Sep 18 04:41:09.431849 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.431828 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f65q5\" (UniqueName: \"kubernetes.io/projected/2398a4aa-d69d-4dbf-bf9f-4e0df09717b8-kube-api-access-f65q5\") pod \"must-gather-wf8vg\" (UID: \"2398a4aa-d69d-4dbf-bf9f-4e0df09717b8\") " pod="openshift-must-gather-xwfjr/must-gather-wf8vg" Sep 18 04:41:09.547658 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.547568 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xwfjr/must-gather-wf8vg" Sep 18 04:41:09.838818 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.838793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xwfjr/must-gather-wf8vg"] Sep 18 04:41:09.840809 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:41:09.840783 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2398a4aa_d69d_4dbf_bf9f_4e0df09717b8.slice/crio-70dec312c5aac70274b53a3dbcae0d5cf171b79b89f6ad175ce7fde253a77293 WatchSource:0}: Error finding container 70dec312c5aac70274b53a3dbcae0d5cf171b79b89f6ad175ce7fde253a77293: Status 404 returned error can't find the container with id 70dec312c5aac70274b53a3dbcae0d5cf171b79b89f6ad175ce7fde253a77293 Sep 18 04:41:09.842481 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:09.842463 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 04:41:10.794963 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:10.794936 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xwfjr/must-gather-wf8vg" event={"ID":"2398a4aa-d69d-4dbf-bf9f-4e0df09717b8","Type":"ContainerStarted","Data":"70dec312c5aac70274b53a3dbcae0d5cf171b79b89f6ad175ce7fde253a77293"} Sep 18 04:41:11.806013 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:11.805974 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xwfjr/must-gather-wf8vg" event={"ID":"2398a4aa-d69d-4dbf-bf9f-4e0df09717b8","Type":"ContainerStarted","Data":"dc1d3d1053433c6897729258a5e1259156bc1ece51ff8e6713e513c6c84ccee3"} Sep 18 04:41:11.806459 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:11.806051 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xwfjr/must-gather-wf8vg" event={"ID":"2398a4aa-d69d-4dbf-bf9f-4e0df09717b8","Type":"ContainerStarted","Data":"c211985376d90df3deb9e9d9d8dbac3f889814f3a712c295f6515a109006a493"} Sep 18 04:41:11.829867 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:11.829799 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xwfjr/must-gather-wf8vg" podStartSLOduration=1.938693239 podStartE2EDuration="2.829776269s" totalImagesPullingTime="891.08303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:41:11.827053144 +0000 UTC m=+1209.345724539" watchObservedRunningTime="2026-09-18 04:41:11.829776269 +0000 UTC m=+1209.348447661" Sep 18 04:41:12.314885 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:12.314852 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4fncm_e3fd06a6-c6b4-4f66-9f86-d9857a390bd1/global-pull-secret-syncer/0.log" Sep 18 04:41:12.505546 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:12.505512 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rhb9v_5810a0f6-ab3e-4945-8090-c6623fc2c473/konnectivity-agent/0.log" Sep 18 04:41:12.528928 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:12.528896 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-31.ec2.internal_769d9c0849764b6dde0e88ec04de02c0/haproxy/0.log" Sep 18 04:41:17.226390 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:17.226366 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b449b7679-ztjts_23381ff8-5935-4287-9938-de3ee65243de/manager/0.log" Sep 18 04:41:17.258945 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:17.258912 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-pp5sg_6a36b5f7-f0ae-4580-8c0b-d777b30dedd7/kuadrant-console-plugin/0.log" Sep 18 04:41:18.821956 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:18.821823 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60efdbef-2140-47c7-966d-3ff3dc2a05a9/alertmanager/0.log" Sep 18 04:41:18.872815 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:18.872787 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60efdbef-2140-47c7-966d-3ff3dc2a05a9/config-reloader/0.log" Sep 18 04:41:18.905868 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:18.905814 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60efdbef-2140-47c7-966d-3ff3dc2a05a9/kube-rbac-proxy-web/0.log" Sep 18 04:41:18.930523 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:18.930436 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60efdbef-2140-47c7-966d-3ff3dc2a05a9/kube-rbac-proxy/0.log" Sep 18 04:41:18.968355 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:18.968329 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60efdbef-2140-47c7-966d-3ff3dc2a05a9/kube-rbac-proxy-metric/0.log" Sep 18 04:41:18.991503 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:18.991478 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60efdbef-2140-47c7-966d-3ff3dc2a05a9/prom-label-proxy/0.log" Sep 18 04:41:19.014914 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.014879 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60efdbef-2140-47c7-966d-3ff3dc2a05a9/init-config-reloader/0.log" Sep 18 04:41:19.108666 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.108638 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-jd2b2_dc485af0-ad6e-4904-b002-33b0fb48b82d/kube-state-metrics/0.log" Sep 18 04:41:19.126933 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.126905 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-jd2b2_dc485af0-ad6e-4904-b002-33b0fb48b82d/kube-rbac-proxy-main/0.log" Sep 18 04:41:19.161345 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.161315 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-jd2b2_dc485af0-ad6e-4904-b002-33b0fb48b82d/kube-rbac-proxy-self/0.log" Sep 18 04:41:19.202753 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.202723 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6b85cc56d-hrll7_761863a3-fb28-49b2-bcfa-ae3639bba659/metrics-server/0.log" Sep 18 04:41:19.245763 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.245720 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-42884_a0ba12c3-244d-4f05-9df9-bd5af2b002aa/monitoring-plugin/0.log" Sep 18 04:41:19.435556 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.435482 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qkd8p_2214f37b-7287-45ad-8662-48eec7d41ba2/node-exporter/0.log" Sep 18 04:41:19.458980 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.458902 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qkd8p_2214f37b-7287-45ad-8662-48eec7d41ba2/kube-rbac-proxy/0.log" Sep 18 04:41:19.484668 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.484646 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qkd8p_2214f37b-7287-45ad-8662-48eec7d41ba2/init-textfile/0.log" Sep 18 04:41:19.591759 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.591688 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-5qjml_a817bf3c-c990-4a00-8291-015e39207640/kube-rbac-proxy-main/0.log" Sep 18 04:41:19.634565 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.634539 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-5qjml_a817bf3c-c990-4a00-8291-015e39207640/kube-rbac-proxy-self/0.log" Sep 18 04:41:19.690644 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.690526 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-5qjml_a817bf3c-c990-4a00-8291-015e39207640/openshift-state-metrics/0.log" Sep 18 04:41:19.760868 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.760842 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16/prometheus/0.log" Sep 18 04:41:19.828654 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.828625 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16/config-reloader/0.log" Sep 18 04:41:19.869014 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.868984 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16/thanos-sidecar/0.log" Sep 18 04:41:19.894086 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.894054 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16/kube-rbac-proxy-web/0.log" Sep 18 04:41:19.917597 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.917566 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16/kube-rbac-proxy/0.log" Sep 18 04:41:19.939378 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.939351 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16/kube-rbac-proxy-thanos/0.log" Sep 18 04:41:19.970350 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:19.970271 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d70ce311-14eb-4ef3-b46b-f7c8f4e8ba16/init-config-reloader/0.log" Sep 18 04:41:20.009354 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.009324 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-kqxxx_f0926b5c-e131-4a5d-8d2d-0fbaf75133da/prometheus-operator/0.log" Sep 18 04:41:20.030856 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.030823 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-kqxxx_f0926b5c-e131-4a5d-8d2d-0fbaf75133da/kube-rbac-proxy/0.log" Sep 18 04:41:20.060520 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.060490 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-fsrhq_02dd49a2-307d-4f97-a93a-6a07c6f2b4ac/prometheus-operator-admission-webhook/0.log" Sep 18 04:41:20.092461 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.092417 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59c7fcd6c8-g4bwh_728063d1-1b47-4420-82fd-2144311542fd/telemeter-client/0.log" Sep 18 04:41:20.119059 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.119008 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59c7fcd6c8-g4bwh_728063d1-1b47-4420-82fd-2144311542fd/reload/0.log" Sep 18 04:41:20.145210 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.145175 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59c7fcd6c8-g4bwh_728063d1-1b47-4420-82fd-2144311542fd/kube-rbac-proxy/0.log" Sep 18 04:41:20.196319 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.196288 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747599d8fb-ww98d_f6637c31-a9d8-4de4-b639-5f1d6fc140fb/thanos-query/0.log" Sep 18 04:41:20.225373 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.225193 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747599d8fb-ww98d_f6637c31-a9d8-4de4-b639-5f1d6fc140fb/kube-rbac-proxy-web/0.log" Sep 18 04:41:20.252460 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.252430 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747599d8fb-ww98d_f6637c31-a9d8-4de4-b639-5f1d6fc140fb/kube-rbac-proxy/0.log" Sep 18 04:41:20.274358 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.274334 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747599d8fb-ww98d_f6637c31-a9d8-4de4-b639-5f1d6fc140fb/prom-label-proxy/0.log" Sep 18 04:41:20.296073 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.296025 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747599d8fb-ww98d_f6637c31-a9d8-4de4-b639-5f1d6fc140fb/kube-rbac-proxy-rules/0.log" Sep 18 04:41:20.318125 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:20.318092 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-747599d8fb-ww98d_f6637c31-a9d8-4de4-b639-5f1d6fc140fb/kube-rbac-proxy-metrics/0.log" Sep 18 04:41:22.267284 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.267244 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t"] Sep 18 04:41:22.273888 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.273863 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.277972 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.277593 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xwfjr\"/\"default-dockercfg-z29k7\"" Sep 18 04:41:22.281418 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.281257 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t"] Sep 18 04:41:22.361560 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.361511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-lib-modules\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.361560 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.361560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-proc\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.361800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.361640 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45xmq\" (UniqueName: \"kubernetes.io/projected/e2b11df2-d92f-493b-ae15-8ddead170e1e-kube-api-access-45xmq\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.361800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.361676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-podres\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.361800 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.361718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-sys\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.462537 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.462484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-lib-modules\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.462537 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.462541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-proc\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.462817 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.462625 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45xmq\" (UniqueName: \"kubernetes.io/projected/e2b11df2-d92f-493b-ae15-8ddead170e1e-kube-api-access-45xmq\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.462817 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.462663 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-podres\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.462817 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.462697 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-lib-modules\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.462817 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.462702 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-proc\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.462817 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.462708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-sys\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.462817 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.462759 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-sys\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.463159 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.462825 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2b11df2-d92f-493b-ae15-8ddead170e1e-podres\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.472564 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.472528 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45xmq\" (UniqueName: \"kubernetes.io/projected/e2b11df2-d92f-493b-ae15-8ddead170e1e-kube-api-access-45xmq\") pod \"perf-node-gather-daemonset-wp28t\" (UID: \"e2b11df2-d92f-493b-ae15-8ddead170e1e\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.590416 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.590389 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:22.640527 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.640485 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-bf7c2_546d87b4-faeb-49cc-b512-958f38fb56f7/download-server/0.log" Sep 18 04:41:22.872439 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.872396 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t"] Sep 18 04:41:22.874560 ip-10-0-132-31 kubenswrapper[2562]: W0918 04:41:22.874491 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode2b11df2_d92f_493b_ae15_8ddead170e1e.slice/crio-857b5456295b3eedcd8c14c20e30d1edc3bf6c2ee9929dee2d06852b91e4557b WatchSource:0}: Error finding container 857b5456295b3eedcd8c14c20e30d1edc3bf6c2ee9929dee2d06852b91e4557b: Status 404 returned error can't find the container with id 857b5456295b3eedcd8c14c20e30d1edc3bf6c2ee9929dee2d06852b91e4557b Sep 18 04:41:22.895355 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:22.895326 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" event={"ID":"e2b11df2-d92f-493b-ae15-8ddead170e1e","Type":"ContainerStarted","Data":"857b5456295b3eedcd8c14c20e30d1edc3bf6c2ee9929dee2d06852b91e4557b"} Sep 18 04:41:23.905912 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:23.905862 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" event={"ID":"e2b11df2-d92f-493b-ae15-8ddead170e1e","Type":"ContainerStarted","Data":"0276d709ef47e2459b8f30c2de5e447e2d97ae6a07af4c2bd9cc1828d9074b35"} Sep 18 04:41:23.906763 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:23.906727 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:23.921506 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:23.921421 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" podStartSLOduration=1.921402945 podStartE2EDuration="1.921402945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:41:23.92134494 +0000 UTC m=+1221.440016341" watchObservedRunningTime="2026-09-18 04:41:23.921402945 +0000 UTC m=+1221.440074363" Sep 18 04:41:24.321789 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:24.321719 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xnsv6_6790211c-1eb7-422b-b94e-e7782817e629/dns/0.log" Sep 18 04:41:24.340901 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:24.340872 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xnsv6_6790211c-1eb7-422b-b94e-e7782817e629/kube-rbac-proxy/0.log" Sep 18 04:41:24.410766 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:24.410739 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cpcdt_0226753d-8c5a-48b5-9c7b-583e15617548/dns-node-resolver/0.log" Sep 18 04:41:24.971863 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:24.971834 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5984d95969-qtdsz_de68f5db-4441-4a3d-aa80-b2b200f439ca/registry/0.log" Sep 18 04:41:25.020092 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:25.020024 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-krsb8_353a5565-874a-4a0e-b82d-986e698a2a36/node-ca/0.log" Sep 18 04:41:26.039914 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:26.039883 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-764f5f45b-8fp25_a585ab93-b609-4977-bab3-615b2c7ce033/kube-auth-proxy/0.log" Sep 18 04:41:26.111394 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:26.111361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc_c099ecb8-f7c2-427f-bbf7-80e93fe7283d/istio-proxy/0.log" Sep 18 04:41:26.849824 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:26.849792 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m2r6c_234101be-031b-4b9e-a70a-41726aaf8450/serve-healthcheck-canary/0.log" Sep 18 04:41:27.431949 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:27.431904 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwpz9_6f1119c2-84eb-4286-8c85-52afcd8d77b2/kube-rbac-proxy/0.log" Sep 18 04:41:27.453077 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:27.453047 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwpz9_6f1119c2-84eb-4286-8c85-52afcd8d77b2/exporter/0.log" Sep 18 04:41:27.473329 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:27.473305 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwpz9_6f1119c2-84eb-4286-8c85-52afcd8d77b2/extractor/0.log" Sep 18 04:41:29.743953 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:29.743924 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-88fcd4466-9xj79_f5977106-7a8d-41ae-ad0d-66d8bc673743/manager/0.log" Sep 18 04:41:29.766221 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:29.766194 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-88fcd4466-9xj79_f5977106-7a8d-41ae-ad0d-66d8bc673743/copy-manifests/0.log" Sep 18 04:41:30.925257 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:30.925227 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-764f5f45b-8fp25_a585ab93-b609-4977-bab3-615b2c7ce033/kube-auth-proxy/0.log" Sep 18 04:41:30.933832 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:30.933804 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-wp28t" Sep 18 04:41:30.976561 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:30.976526 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc_c099ecb8-f7c2-427f-bbf7-80e93fe7283d/istio-proxy/0.log" Sep 18 04:41:31.040877 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:31.040851 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-88847cdbd-mvp4s_43077d0d-344c-4df7-9645-9990d36f1a13/manager/0.log" Sep 18 04:41:32.052743 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:32.052699 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-hxs87_2b077fc4-b21d-40b7-8707-4f6982e87867/manager/0.log" Sep 18 04:41:32.242827 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:32.242738 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-764f5f45b-8fp25_a585ab93-b609-4977-bab3-615b2c7ce033/kube-auth-proxy/0.log" Sep 18 04:41:32.309794 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:32.309677 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6987f5b5b9-847kc_c099ecb8-f7c2-427f-bbf7-80e93fe7283d/istio-proxy/0.log" Sep 18 04:41:38.969092 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:38.969058 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5x27n_d7a3defb-be96-4c25-80b8-72fbb9998a24/kube-multus/0.log" Sep 18 04:41:39.425218 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:39.425191 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxkjc_1abb6f25-c656-4523-a5f7-d347cc63b7e2/kube-multus-additional-cni-plugins/0.log" Sep 18 04:41:39.446457 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:39.446435 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxkjc_1abb6f25-c656-4523-a5f7-d347cc63b7e2/egress-router-binary-copy/0.log" Sep 18 04:41:39.465421 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:39.465379 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxkjc_1abb6f25-c656-4523-a5f7-d347cc63b7e2/cni-plugins/0.log" Sep 18 04:41:39.484389 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:39.484361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxkjc_1abb6f25-c656-4523-a5f7-d347cc63b7e2/bond-cni-plugin/0.log" Sep 18 04:41:39.503876 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:39.503844 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxkjc_1abb6f25-c656-4523-a5f7-d347cc63b7e2/routeoverride-cni/0.log" Sep 18 04:41:39.523809 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:39.523788 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxkjc_1abb6f25-c656-4523-a5f7-d347cc63b7e2/whereabouts-cni-bincopy/0.log" Sep 18 04:41:39.542609 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:39.542586 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxkjc_1abb6f25-c656-4523-a5f7-d347cc63b7e2/whereabouts-cni/0.log" Sep 18 04:41:39.676943 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:39.676869 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fn5bz_03823fc1-c5c8-471d-825a-256e029b9bce/network-metrics-daemon/0.log" Sep 18 04:41:39.695953 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:39.695927 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fn5bz_03823fc1-c5c8-471d-825a-256e029b9bce/kube-rbac-proxy/0.log" Sep 18 04:41:40.827165 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:40.827133 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvht_c47c4573-b277-4a8a-8aee-d5b81b9275dd/ovn-controller/0.log" Sep 18 04:41:40.843831 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:40.843801 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvht_c47c4573-b277-4a8a-8aee-d5b81b9275dd/ovn-acl-logging/0.log" Sep 18 04:41:40.865665 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:40.865580 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvht_c47c4573-b277-4a8a-8aee-d5b81b9275dd/kube-rbac-proxy-node/0.log" Sep 18 04:41:40.887204 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:40.887142 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvht_c47c4573-b277-4a8a-8aee-d5b81b9275dd/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 04:41:40.913632 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:40.913593 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvht_c47c4573-b277-4a8a-8aee-d5b81b9275dd/northd/0.log" Sep 18 04:41:40.932317 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:40.932290 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvht_c47c4573-b277-4a8a-8aee-d5b81b9275dd/nbdb/0.log" Sep 18 04:41:40.952233 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:40.952209 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvht_c47c4573-b277-4a8a-8aee-d5b81b9275dd/sbdb/0.log" Sep 18 04:41:40.996134 ip-10-0-132-31 kubenswrapper[2562]: I0918 04:41:40.996109 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mxvht_c47c4573-b277-4a8a-8aee-d5b81b9275dd/ovnkube-controller/0.log"