Oct 30 18:36:37.313233 ip-10-0-135-87 systemd[1]: Starting Kubernetes Kubelet... Oct 30 18:36:37.664812 ip-10-0-135-87 kubenswrapper[2544]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:36:37.664812 ip-10-0-135-87 kubenswrapper[2544]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 18:36:37.664812 ip-10-0-135-87 kubenswrapper[2544]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:36:37.664812 ip-10-0-135-87 kubenswrapper[2544]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:36:37.668753 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668662 2544 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:37.668753 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668752 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:37.668753 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668757 2544 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:37.668753 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668760 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668763 2544 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668766 2544 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668769 2544 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668773 2544 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668776 2544 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668779 2544 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668782 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668784 2544 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668789 2544 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668793 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668796 2544 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668799 2544 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668802 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668805 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668808 2544 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668813 2544 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668822 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668825 2544 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:37.668872 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668828 2544 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668832 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668835 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668837 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668840 2544 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668843 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668845 2544 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668848 2544 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668850 2544 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668853 2544 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668856 2544 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668859 2544 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668861 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668864 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668867 2544 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668870 2544 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668873 2544 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668876 2544 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668879 2544 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668882 2544 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:37.669331 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668885 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668887 2544 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668890 2544 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668892 2544 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668895 2544 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668897 2544 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668900 2544 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668914 2544 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668917 2544 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668920 2544 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668922 2544 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668925 2544 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668928 2544 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668930 2544 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668933 2544 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668936 2544 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668938 2544 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668941 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668944 2544 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668946 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:37.669796 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668949 2544 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668952 2544 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668955 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668957 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668960 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668963 2544 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668966 2544 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668969 2544 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668972 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668974 2544 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668977 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668980 2544 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668983 2544 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668985 2544 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668988 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668991 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668994 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668997 2544 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.668999 2544 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:37.670280 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669002 2544 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669004 2544 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669007 2544 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669010 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669012 2544 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669015 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669017 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669020 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669022 2544 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669025 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669028 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669031 2544 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669033 2544 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669036 2544 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669040 2544 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669043 2544 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669045 2544 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669048 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669051 2544 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:37.670723 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669056 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669058 2544 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669061 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669063 2544 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669066 2544 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669069 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669852 2544 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669859 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669862 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669865 2544 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669867 2544 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669870 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669873 2544 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669875 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669878 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669881 2544 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669883 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669886 2544 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669888 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:37.671195 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669891 2544 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669894 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669896 2544 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669899 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669901 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669918 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669920 2544 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669923 2544 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669926 2544 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669929 2544 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669932 2544 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669934 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669938 2544 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669941 2544 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669944 2544 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669946 2544 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669949 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669952 2544 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669954 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669957 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:37.671702 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669960 2544 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669963 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669965 2544 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669968 2544 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669970 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669973 2544 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669975 2544 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669978 2544 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669981 2544 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669984 2544 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669987 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669990 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669992 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669995 2544 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.669998 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670001 2544 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670004 2544 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670006 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670009 2544 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:37.672196 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670011 2544 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670014 2544 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670017 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670020 2544 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670022 2544 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670026 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670028 2544 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670031 2544 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670033 2544 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670036 2544 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670038 2544 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670041 2544 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670044 2544 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670047 2544 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670049 2544 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670052 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670054 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670057 2544 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670060 2544 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:37.672659 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670062 2544 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670065 2544 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670067 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670070 2544 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670072 2544 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670075 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670079 2544 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670083 2544 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670087 2544 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670091 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670095 2544 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670097 2544 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670101 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670103 2544 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670106 2544 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670109 2544 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670111 2544 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670114 2544 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670117 2544 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:37.673131 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670120 2544 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670122 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670125 2544 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670127 2544 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670130 2544 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670133 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670135 2544 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670138 2544 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670142 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670145 2544 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670147 2544 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670149 2544 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670152 2544 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670154 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670157 2544 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670160 2544 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670672 2544 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670677 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670680 2544 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:37.673591 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670683 2544 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670686 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670688 2544 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670691 2544 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670694 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670696 2544 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670699 2544 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670702 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670705 2544 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670708 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670711 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670713 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670715 2544 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670718 2544 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670721 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670723 2544 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670726 2544 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670728 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670731 2544 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:37.674052 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670734 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670736 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670740 2544 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670742 2544 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670745 2544 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670748 2544 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670750 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670753 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670755 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670758 2544 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670760 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670763 2544 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670765 2544 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670768 2544 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670771 2544 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670775 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670779 2544 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670782 2544 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670785 2544 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:37.674499 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670788 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670791 2544 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670794 2544 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670797 2544 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670799 2544 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670802 2544 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670804 2544 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670807 2544 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670810 2544 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670814 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670817 2544 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670820 2544 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670822 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670825 2544 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670827 2544 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670830 2544 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670836 2544 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670839 2544 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670841 2544 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670844 2544 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:37.674954 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670846 2544 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670849 2544 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670851 2544 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670854 2544 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670857 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670859 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670862 2544 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670865 2544 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670868 2544 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670870 2544 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670873 2544 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670875 2544 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670878 2544 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670881 2544 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670883 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670886 2544 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670889 2544 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670891 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670894 2544 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:37.675426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670896 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670899 2544 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670901 2544 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670917 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670920 2544 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670922 2544 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670925 2544 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670928 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670930 2544 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670934 2544 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670938 2544 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670940 2544 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670944 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670947 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670949 2544 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670952 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670955 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670957 2544 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670960 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670963 2544 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:37.675899 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670965 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670968 2544 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670970 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670973 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670976 2544 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.670978 2544 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.671965 2544 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.671975 2544 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.671983 2544 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.671988 2544 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.671993 2544 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.671996 2544 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672001 2544 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672006 2544 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672009 2544 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672012 2544 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672016 2544 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672019 2544 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672023 2544 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672026 2544 flags.go:64] FLAG: --cgroup-root="" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672029 2544 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672035 2544 flags.go:64] FLAG: --client-ca-file="" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672038 2544 flags.go:64] FLAG: --cloud-provider="external" Oct 30 18:36:37.676426 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672042 2544 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672045 2544 flags.go:64] FLAG: --cluster-domain="" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672048 2544 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672052 2544 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672055 2544 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672063 2544 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672067 2544 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672071 2544 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672074 2544 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672077 2544 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672081 2544 flags.go:64] FLAG: --contention-profiling="false" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672084 2544 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672087 2544 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672090 2544 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672093 2544 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672097 2544 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672100 2544 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672103 2544 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672106 2544 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672109 2544 flags.go:64] FLAG: --enable-server="true" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672112 2544 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672117 2544 flags.go:64] FLAG: --event-burst="100" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672120 2544 flags.go:64] FLAG: --event-qps="50" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672123 2544 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 18:36:37.676996 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672126 2544 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672129 2544 flags.go:64] FLAG: --eviction-hard="" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672134 2544 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672137 2544 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672140 2544 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672143 2544 flags.go:64] FLAG: --eviction-soft="" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672147 2544 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672151 2544 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672154 2544 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672157 2544 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672161 2544 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672164 2544 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672167 2544 flags.go:64] FLAG: --feature-gates="" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672173 2544 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672176 2544 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672179 2544 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672182 2544 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672186 2544 flags.go:64] FLAG: --healthz-port="10248" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672189 2544 flags.go:64] FLAG: --help="false" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672192 2544 flags.go:64] FLAG: --hostname-override="ip-10-0-135-87.ec2.internal" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672195 2544 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672198 2544 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672201 2544 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672205 2544 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 18:36:37.677578 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672208 2544 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672211 2544 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672214 2544 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672217 2544 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672220 2544 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672223 2544 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672227 2544 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672230 2544 flags.go:64] FLAG: --kube-reserved="" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672232 2544 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672235 2544 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672238 2544 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672241 2544 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672244 2544 flags.go:64] FLAG: --lock-file="" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672247 2544 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672251 2544 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672254 2544 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672260 2544 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672263 2544 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672266 2544 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672269 2544 flags.go:64] FLAG: --logging-format="text" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672273 2544 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672277 2544 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672280 2544 flags.go:64] FLAG: --manifest-url="" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672283 2544 flags.go:64] FLAG: --manifest-url-header="" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672287 2544 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 18:36:37.678248 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672291 2544 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672294 2544 flags.go:64] FLAG: --max-pods="110" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672297 2544 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672300 2544 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672303 2544 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672306 2544 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672309 2544 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672312 2544 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672315 2544 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672322 2544 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672325 2544 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672329 2544 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672332 2544 flags.go:64] FLAG: --pod-cidr="" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672335 2544 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672337 2544 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672340 2544 flags.go:64] FLAG: --pods-per-core="0" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672343 2544 flags.go:64] FLAG: --port="10250" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672346 2544 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672349 2544 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09758dfa71d853fa2" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672352 2544 flags.go:64] FLAG: --qos-reserved="" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672355 2544 flags.go:64] FLAG: --read-only-port="10255" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672360 2544 flags.go:64] FLAG: --register-node="true" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672362 2544 flags.go:64] FLAG: --register-with-taints="" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672367 2544 flags.go:64] FLAG: --registry-burst="10" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672369 2544 flags.go:64] FLAG: --registry-qps="5" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672372 2544 flags.go:64] FLAG: --reserved-cpus="" Oct 30 18:36:37.678866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672380 2544 flags.go:64] FLAG: --reserved-memory="" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672389 2544 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672392 2544 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672395 2544 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672398 2544 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672401 2544 flags.go:64] FLAG: --runonce="false" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672405 2544 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672408 2544 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672411 2544 flags.go:64] FLAG: --seccomp-default="false" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672413 2544 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672416 2544 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672420 2544 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672423 2544 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672426 2544 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672429 2544 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672432 2544 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672435 2544 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672438 2544 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672441 2544 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672444 2544 flags.go:64] FLAG: --system-cgroups="" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672447 2544 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672452 2544 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672455 2544 flags.go:64] FLAG: --tls-cert-file="" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672458 2544 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672461 2544 flags.go:64] FLAG: --tls-min-version="" Oct 30 18:36:37.679552 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672464 2544 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672467 2544 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672472 2544 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672474 2544 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672478 2544 flags.go:64] FLAG: --v="2" Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672482 2544 flags.go:64] FLAG: --version="false" Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672487 2544 flags.go:64] FLAG: --vmodule="" Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672491 2544 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.672494 2544 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672680 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672687 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672690 2544 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672693 2544 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672696 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672698 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672701 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672704 2544 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672706 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672709 2544 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672711 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672714 2544 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672717 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:37.680442 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672719 2544 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672722 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672724 2544 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672727 2544 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672729 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672732 2544 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672734 2544 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672738 2544 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672740 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672743 2544 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672745 2544 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672748 2544 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672751 2544 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672753 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672756 2544 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672760 2544 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672764 2544 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672766 2544 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672769 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672778 2544 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:37.681165 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672780 2544 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672783 2544 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672785 2544 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672788 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672790 2544 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672793 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672795 2544 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672798 2544 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672800 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672803 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672805 2544 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672808 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672810 2544 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672813 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672816 2544 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672818 2544 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672821 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672823 2544 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672825 2544 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:37.681649 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672828 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672830 2544 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672833 2544 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672836 2544 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672838 2544 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672841 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672843 2544 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672848 2544 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672850 2544 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672853 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672855 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672858 2544 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672860 2544 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672869 2544 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672872 2544 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672874 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672877 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672880 2544 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672883 2544 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:37.682117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672885 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672888 2544 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672890 2544 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672893 2544 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672896 2544 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672898 2544 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672901 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672915 2544 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672918 2544 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672920 2544 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672923 2544 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672926 2544 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672928 2544 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672931 2544 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672934 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672937 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672939 2544 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672942 2544 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672944 2544 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:37.682560 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672947 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672952 2544 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672957 2544 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672960 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672963 2544 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672966 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672969 2544 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672971 2544 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672980 2544 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672982 2544 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672985 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672988 2544 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672990 2544 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672993 2544 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672996 2544 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.672998 2544 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:37.683059 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.673026 2544 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673080 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673085 2544 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673087 2544 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673090 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673093 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673096 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673098 2544 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673100 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673103 2544 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673105 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673108 2544 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673110 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673113 2544 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673115 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673118 2544 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673121 2544 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673123 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673127 2544 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673130 2544 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:37.683435 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673132 2544 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673135 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673138 2544 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673140 2544 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673143 2544 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673152 2544 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673155 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673157 2544 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673161 2544 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673165 2544 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673168 2544 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673171 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673174 2544 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673177 2544 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673179 2544 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673181 2544 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673184 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673186 2544 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673189 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673192 2544 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:37.683924 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673194 2544 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673197 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673199 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673201 2544 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673204 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673207 2544 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673211 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673213 2544 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673216 2544 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673219 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673222 2544 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673225 2544 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673227 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673230 2544 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673233 2544 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673235 2544 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673238 2544 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673241 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673249 2544 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:37.684400 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673252 2544 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673254 2544 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673257 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673259 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673262 2544 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673264 2544 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673267 2544 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673269 2544 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673272 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673274 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673283 2544 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673286 2544 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673289 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673291 2544 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673293 2544 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673296 2544 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673298 2544 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673301 2544 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673303 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:37.684856 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673307 2544 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673310 2544 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673313 2544 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673315 2544 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673319 2544 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673322 2544 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673324 2544 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673327 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673330 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673332 2544 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673335 2544 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673337 2544 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673340 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673349 2544 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673353 2544 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673356 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673358 2544 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673361 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673364 2544 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:37.685314 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673366 2544 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673374 2544 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673377 2544 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673380 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673383 2544 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673385 2544 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673389 2544 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673391 2544 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673394 2544 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.673396 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.681963 2544 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.681983 2544 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.682593 2544 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.682599 2544 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682660 2544 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682666 2544 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682670 2544 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682672 2544 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682676 2544 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:37.685803 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682678 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682681 2544 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682684 2544 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682687 2544 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682689 2544 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682692 2544 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682695 2544 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682697 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682700 2544 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682703 2544 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682706 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682709 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682711 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682714 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682717 2544 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682719 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682722 2544 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682725 2544 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682727 2544 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:37.686292 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682730 2544 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682732 2544 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682735 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682747 2544 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682751 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682754 2544 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682757 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682760 2544 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682763 2544 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682765 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682769 2544 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682773 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682776 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682780 2544 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682783 2544 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682786 2544 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682789 2544 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682792 2544 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682794 2544 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682797 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:37.686776 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682800 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682802 2544 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682811 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682814 2544 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682816 2544 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682819 2544 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682821 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682825 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682828 2544 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682831 2544 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682833 2544 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682836 2544 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682839 2544 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682841 2544 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682844 2544 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682846 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682849 2544 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682852 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682855 2544 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682858 2544 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:37.687432 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682860 2544 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682863 2544 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682866 2544 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682868 2544 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682871 2544 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682873 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682876 2544 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682878 2544 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682882 2544 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682886 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682889 2544 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682892 2544 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682895 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682898 2544 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682900 2544 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682923 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682927 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682929 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682932 2544 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:37.688033 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682935 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682938 2544 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682941 2544 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682943 2544 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682946 2544 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682948 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682951 2544 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682954 2544 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682957 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682960 2544 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682963 2544 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682965 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682968 2544 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682971 2544 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682973 2544 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682976 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682978 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682981 2544 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682983 2544 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682986 2544 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:37.688487 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682989 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682991 2544 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.682994 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.683022 2544 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683176 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683181 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683185 2544 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683188 2544 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683191 2544 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683196 2544 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683200 2544 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683203 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683207 2544 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683210 2544 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683213 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683216 2544 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:37.689069 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683219 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683222 2544 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683224 2544 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683227 2544 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683230 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683233 2544 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683235 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683238 2544 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683241 2544 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683243 2544 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683246 2544 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683249 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683251 2544 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683254 2544 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683257 2544 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683259 2544 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683262 2544 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683264 2544 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683267 2544 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:37.689467 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683270 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683272 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683276 2544 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683280 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683283 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683287 2544 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683289 2544 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683293 2544 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683295 2544 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683298 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683301 2544 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683303 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683306 2544 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683308 2544 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683311 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683313 2544 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683316 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683318 2544 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683321 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683324 2544 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:37.690205 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683326 2544 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683329 2544 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683331 2544 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683334 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683337 2544 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683340 2544 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683342 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683345 2544 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683347 2544 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683350 2544 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683352 2544 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683354 2544 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683357 2544 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683359 2544 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683362 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683365 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683367 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683370 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683372 2544 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683375 2544 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:37.690881 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683378 2544 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683380 2544 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683383 2544 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683406 2544 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683410 2544 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683414 2544 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683416 2544 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683419 2544 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683422 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683424 2544 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683427 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683429 2544 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683432 2544 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683435 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683437 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683440 2544 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683443 2544 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683445 2544 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683448 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683451 2544 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:37.691505 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683453 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683456 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683458 2544 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683460 2544 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683463 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683465 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683468 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683470 2544 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683473 2544 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683476 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683478 2544 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683480 2544 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683483 2544 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683487 2544 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683489 2544 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.683512 2544 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:36:37.691985 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683546 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683550 2544 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683553 2544 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683556 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683558 2544 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683561 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683563 2544 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683566 2544 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683568 2544 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683571 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683574 2544 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683576 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683578 2544 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683581 2544 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683583 2544 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683586 2544 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683589 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683592 2544 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683594 2544 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:37.692617 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683597 2544 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683599 2544 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683602 2544 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683605 2544 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683607 2544 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683610 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683612 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683616 2544 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683621 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683624 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683627 2544 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683630 2544 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683633 2544 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683635 2544 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683638 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683640 2544 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683643 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683645 2544 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683648 2544 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:37.693159 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683650 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683653 2544 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683655 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683658 2544 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683660 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683663 2544 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683665 2544 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683668 2544 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683670 2544 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683674 2544 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683681 2544 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683684 2544 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683687 2544 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683689 2544 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683692 2544 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683694 2544 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683697 2544 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683699 2544 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683702 2544 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683705 2544 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:37.693633 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683707 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683710 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683712 2544 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683715 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683718 2544 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683721 2544 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683723 2544 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683726 2544 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683729 2544 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683731 2544 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683734 2544 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683736 2544 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683739 2544 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683741 2544 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683744 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683746 2544 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683749 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683751 2544 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683754 2544 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:37.694134 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683756 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683759 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683762 2544 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683766 2544 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683770 2544 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683773 2544 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683775 2544 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683778 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683781 2544 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683783 2544 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683786 2544 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683788 2544 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683791 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683794 2544 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683796 2544 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683799 2544 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683801 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683804 2544 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683806 2544 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683810 2544 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:37.694608 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683812 2544 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683815 2544 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683817 2544 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683820 2544 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683823 2544 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683825 2544 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683828 2544 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683833 2544 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:37.683836 2544 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.683900 2544 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.686172 2544 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.686995 2544 server.go:1014] "Starting client certificate rotation" Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.687094 2544 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.687749 2544 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.689150 2544 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 18:36:37.695242 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.691841 2544 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 18:36:37.701236 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.701219 2544 log.go:25] "Validated CRI v1 runtime API" Oct 30 18:36:37.704549 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.704534 2544 log.go:25] "Validated CRI v1 image API" Oct 30 18:36:37.705418 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.705398 2544 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 18:36:37.707815 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.707797 2544 fs.go:135] Filesystem UUIDs: map[29800dd5-3e7a-4370-a397-b029dce5f7dd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 81736c32-7a31-4222-8333-4f5a3acb2074:/dev/nvme0n1p4] Oct 30 18:36:37.707867 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.707815 2544 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 18:36:37.713774 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.713639 2544 manager.go:217] Machine: {Timestamp:2026-10-30 18:36:37.712230456 +0000 UTC m=+0.296931166 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100168 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b43cae54d6d5b8d9d5dc2526cb2b1 SystemUUID:ec2b43ca-e54d-6d5b-8d9d-5dc2526cb2b1 BootID:ff52c89f-7b4b-46ca-b0a0-fe869c29f284 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f4:f6:0e:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f4:f6:0e:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:6e:25:90:e8:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 18:36:37.713774 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.713767 2544 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 18:36:37.713937 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.713851 2544 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 18:36:37.716717 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.716691 2544 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 18:36:37.716858 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.716718 2544 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 18:36:37.716925 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.716860 2544 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 18:36:37.716925 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.716868 2544 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 18:36:37.716925 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.716893 2544 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 18:36:37.716925 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.716917 2544 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 18:36:37.717864 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.717849 2544 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 18:36:37.722036 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.722024 2544 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 18:36:37.722161 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.722151 2544 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 18:36:37.722815 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.722806 2544 kubelet.go:493] "Attempting to sync node with API server" Oct 30 18:36:37.722845 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.722821 2544 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 18:36:37.722871 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.722862 2544 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 18:36:37.722898 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.722871 2544 kubelet.go:405] "Adding apiserver pod source" Oct 30 18:36:37.722898 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.722880 2544 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 18:36:37.723358 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.723325 2544 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 18:36:37.726312 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.726284 2544 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 18:36:37.732235 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.732218 2544 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 18:36:37.733056 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733041 2544 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 18:36:37.733115 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733074 2544 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 18:36:37.733259 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733247 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 18:36:37.733314 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733265 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 18:36:37.733314 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733271 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 18:36:37.733314 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733277 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 18:36:37.733314 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733283 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 18:36:37.733314 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733291 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 18:36:37.733750 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733738 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 18:36:37.733750 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733748 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 18:36:37.733823 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733755 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 18:36:37.733823 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733766 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 18:36:37.733823 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733775 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 18:36:37.733823 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.733785 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 18:36:37.734409 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.734400 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 18:36:37.734453 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.734412 2544 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 18:36:37.738372 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.738356 2544 server.go:1263] "Started kubelet" Oct 30 18:36:37.738488 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.738451 2544 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 18:36:37.738586 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.738464 2544 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 18:36:37.738586 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.738565 2544 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 18:36:37.739174 ip-10-0-135-87 systemd[1]: Started Kubernetes Kubelet. Oct 30 18:36:37.739807 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.739787 2544 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 18:36:37.740934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.740895 2544 server.go:317] "Adding debug handlers to kubelet server" Oct 30 18:36:37.744323 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.744295 2544 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 18:36:37.747415 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.747397 2544 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 18:36:37.747965 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.747947 2544 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 18:36:37.748511 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.748468 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:37.748643 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.748631 2544 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 18:36:37.748684 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.748647 2544 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 18:36:37.748720 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.748690 2544 factory.go:55] Registering systemd factory Oct 30 18:36:37.748750 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.748724 2544 reconstruct.go:97] "Volume reconstruction finished" Oct 30 18:36:37.748750 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.748730 2544 reconciler.go:29] "Reconciler: start to sync state" Oct 30 18:36:37.748750 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.748631 2544 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 18:36:37.748750 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.748724 2544 factory.go:223] Registration of the systemd container factory successfully Oct 30 18:36:37.748985 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.748960 2544 factory.go:153] Registering CRI-O factory Oct 30 18:36:37.748985 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.748975 2544 factory.go:223] Registration of the crio container factory successfully Oct 30 18:36:37.749082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.749033 2544 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 18:36:37.749082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.749056 2544 factory.go:103] Registering Raw factory Oct 30 18:36:37.749082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.749071 2544 manager.go:1199] Started watching for new ooms in manager Oct 30 18:36:37.749866 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.749851 2544 manager.go:319] Starting recovery of all containers Oct 30 18:36:37.761011 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.760992 2544 manager.go:324] Recovery completed Oct 30 18:36:37.765622 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.765608 2544 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:36:37.767424 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.767408 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:36:37.767488 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.767436 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:36:37.767488 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.767446 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:36:37.767937 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.767894 2544 cpu_manager.go:226] "Starting" policy="none" Oct 30 18:36:37.768004 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.767942 2544 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:36:37.768004 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.767961 2544 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 18:36:37.768004 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.767982 2544 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 18:36:37.768619 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.768599 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:36:37.768677 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.768633 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:36:37.768677 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.768644 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:36:37.770214 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.770197 2544 policy_none.go:50] "Start" Oct 30 18:36:37.770295 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.770218 2544 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 18:36:37.770295 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.770233 2544 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 18:36:37.771588 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.771557 2544 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 18:36:37.771702 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.771679 2544 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 18:36:37.772274 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.772262 2544 policy_none.go:44] "Start" Oct 30 18:36:37.772418 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.771559 2544 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-87.ec2.internal.18e362847990c99a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-87.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-87.ec2.internal,},FirstTimestamp:2026-10-30 18:36:37.738326426 +0000 UTC m=+0.323027137,LastTimestamp:2026-10-30 18:36:37.738326426 +0000 UTC m=+0.323027137,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-87.ec2.internal,}" Oct 30 18:36:37.786197 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.785788 2544 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-87.ec2.internal.18e362847b4cc57d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-87.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-87.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-87.ec2.internal,},FirstTimestamp:2026-10-30 18:36:37.767423357 +0000 UTC m=+0.352124067,LastTimestamp:2026-10-30 18:36:37.767423357 +0000 UTC m=+0.352124067,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-87.ec2.internal,}" Oct 30 18:36:37.786543 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.786513 2544 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 18:36:37.786543 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.786515 2544 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 18:36:37.786677 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.786518 2544 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 18:36:37.786677 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.786666 2544 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 18:36:37.800523 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.800490 2544 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.803676 2544 manager.go:341] "Starting Device Plugin manager" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.804323 2544 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.804343 2544 server.go:87] "Starting device plugin registration server" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.804617 2544 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.804638 2544 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.804719 2544 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.804793 2544 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.804801 2544 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.805326 2544 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.805376 2544 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.808980 2544 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g5pbh" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.815656 2544 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-87.ec2.internal.18e362847b4d0c01 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-87.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-87.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-87.ec2.internal,},FirstTimestamp:2026-10-30 18:36:37.767441409 +0000 UTC m=+0.352142119,LastTimestamp:2026-10-30 18:36:37.767441409 +0000 UTC m=+0.352142119,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-87.ec2.internal,}" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.817329 2544 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.818499 2544 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.818519 2544 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.818536 2544 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.818569 2544 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 18:36:37.829019 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.821544 2544 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g5pbh" Oct 30 18:36:37.832514 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.832139 2544 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-87.ec2.internal.18e362847b4d2fe6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-87.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-87.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-87.ec2.internal,},FirstTimestamp:2026-10-30 18:36:37.767450598 +0000 UTC m=+0.352151308,LastTimestamp:2026-10-30 18:36:37.767450598 +0000 UTC m=+0.352151308,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-87.ec2.internal,}" Oct 30 18:36:37.861031 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.861007 2544 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:36:37.905190 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.905159 2544 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:36:37.906194 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.906172 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:36:37.906311 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.906209 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:36:37.906311 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.906223 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:36:37.906311 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.906252 2544 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-87.ec2.internal" Oct 30 18:36:37.919536 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.919468 2544 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal"] Oct 30 18:36:37.919536 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.919523 2544 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:36:37.920290 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.920276 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:36:37.920357 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.920303 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:36:37.920357 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.920315 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:36:37.922547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.922533 2544 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:36:37.922705 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.922689 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:36:37.922747 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.922724 2544 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:36:37.923222 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.923199 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:36:37.923222 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.923213 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:36:37.923372 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.923229 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:36:37.923372 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.923234 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:36:37.923372 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.923243 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:36:37.923372 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.923247 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:36:37.925341 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.925324 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:36:37.925428 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.925352 2544 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:36:37.925797 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.925781 2544 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-87.ec2.internal" Oct 30 18:36:37.925844 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.925808 2544 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-87.ec2.internal\": node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:37.926059 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.926046 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:36:37.926136 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.926075 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:36:37.926136 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:37.926089 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:36:37.958997 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.958968 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:37.961130 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.961110 2544 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-87.ec2.internal\" not found" node="ip-10-0-135-87.ec2.internal" Oct 30 18:36:37.963327 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:37.963313 2544 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-87.ec2.internal\" not found" node="ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.050198 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.050168 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac0cf868632d3632743a3feebbcd95ab-config\") pod \"kube-apiserver-proxy-ip-10-0-135-87.ec2.internal\" (UID: \"ac0cf868632d3632743a3feebbcd95ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.050198 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.050196 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.050343 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.050236 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.059882 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:38.059866 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:38.151190 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.151160 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac0cf868632d3632743a3feebbcd95ab-config\") pod \"kube-apiserver-proxy-ip-10-0-135-87.ec2.internal\" (UID: \"ac0cf868632d3632743a3feebbcd95ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.151190 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.151192 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.151349 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.151208 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.151349 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.151258 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac0cf868632d3632743a3feebbcd95ab-config\") pod \"kube-apiserver-proxy-ip-10-0-135-87.ec2.internal\" (UID: \"ac0cf868632d3632743a3feebbcd95ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.151349 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.151316 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.151454 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.151350 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.160279 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:38.160261 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:38.260655 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:38.260621 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:38.265792 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.265773 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.266870 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.266856 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:36:38.361872 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:38.361678 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:38.462181 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:38.462151 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:38.562791 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:38.562726 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:38.658284 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.658255 2544 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:36:38.663259 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:38.663239 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:38.687398 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.687375 2544 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 18:36:38.687762 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.687485 2544 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 18:36:38.687762 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.687511 2544 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 18:36:38.763346 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:38.763316 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:38.793554 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.793525 2544 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:36:38.827697 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.827668 2544 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 18:31:38 +0000 UTC" deadline="2028-05-08 00:26:09.645468062 +0000 UTC" Oct 30 18:36:38.827769 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.827697 2544 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13325h49m30.817774796s" Oct 30 18:36:38.838670 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:38.838637 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0cf868632d3632743a3feebbcd95ab.slice/crio-ee4718b131dc859a27be32a337818f475ba4de9f2022aec44f1add83b45b1d60 WatchSource:0}: Error finding container ee4718b131dc859a27be32a337818f475ba4de9f2022aec44f1add83b45b1d60: Status 404 returned error can't find the container with id ee4718b131dc859a27be32a337818f475ba4de9f2022aec44f1add83b45b1d60 Oct 30 18:36:38.838958 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:38.838938 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8836c14af0409d863d60cb41effd982.slice/crio-6e66ee694c5994ea53aafe0c1e533a8a44d24412031115abf96d78b293e64d96 WatchSource:0}: Error finding container 6e66ee694c5994ea53aafe0c1e533a8a44d24412031115abf96d78b293e64d96: Status 404 returned error can't find the container with id 6e66ee694c5994ea53aafe0c1e533a8a44d24412031115abf96d78b293e64d96 Oct 30 18:36:38.844193 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.844178 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 18:36:38.864134 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:38.864110 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:38.880826 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.880802 2544 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:36:38.884438 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.884418 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:36:38.884543 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.884450 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:36:38.884543 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:38.884461 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:36:38.964705 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:38.964651 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:39.065350 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.065301 2544 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:36:39.105016 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.104943 2544 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:36:39.148927 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.148879 2544 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:36:39.181041 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.181016 2544 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 18:36:39.182014 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.181997 2544 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:36:39.203449 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.203421 2544 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 18:36:39.723862 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.723825 2544 apiserver.go:52] "Watching apiserver" Oct 30 18:36:39.748095 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.748069 2544 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 18:36:39.774845 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.774161 2544 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 18:36:39.774845 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.774517 2544 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-d64wt","openshift-network-diagnostics/network-check-target-r8cj4","openshift-network-operator/iptables-alerter-zl8dn","kube-system/konnectivity-agent-9lgj6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal","openshift-multus/multus-9n4ts","openshift-multus/network-metrics-daemon-fkxqh","openshift-cluster-node-tuning-operator/tuned-2cklg","openshift-ovn-kubernetes/ovnkube-node-9mb54","kube-system/global-pull-secret-syncer-rsknn","kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal","openshift-dns/node-resolver-bvrtd","openshift-image-registry/node-ca-kbg25"] Oct 30 18:36:39.777675 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.777652 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.779809 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.779788 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:39.782700 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.782321 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:39.784812 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.784788 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:39.787341 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.787317 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.789773 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.789756 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:39.792711 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.792689 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.795516 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.795449 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.795604 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.795518 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-d56w6\"" Oct 30 18:36:39.795742 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.795723 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 18:36:39.795886 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.795871 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 18:36:39.795982 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.795968 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 18:36:39.796114 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.796100 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 18:36:39.796461 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.796436 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 18:36:39.796606 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.796581 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h68zm\"" Oct 30 18:36:39.796684 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.796632 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 18:36:39.801103 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.801084 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:39.801209 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.801154 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:39.803483 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.803462 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 18:36:39.803597 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.803490 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 18:36:39.803736 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.803697 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-t7f6r\"" Oct 30 18:36:39.804011 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.803989 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84qrk\"" Oct 30 18:36:39.804306 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.804068 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 18:36:39.804441 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.804418 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 18:36:39.804526 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.804512 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 18:36:39.804602 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.804590 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 18:36:39.804644 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.804629 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 18:36:39.804644 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.804629 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 18:36:39.804716 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.804698 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dzmp9\"" Oct 30 18:36:39.805057 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.805033 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.807186 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.807168 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 18:36:39.807652 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.807633 2544 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 18:36:39.807797 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.807783 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:39.807879 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.807843 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:39.810133 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.810102 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:39.810234 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.810170 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:36:39.824096 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.824044 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" event={"ID":"ac0cf868632d3632743a3feebbcd95ab","Type":"ContainerStarted","Data":"ee4718b131dc859a27be32a337818f475ba4de9f2022aec44f1add83b45b1d60"} Oct 30 18:36:39.825341 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.825305 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" event={"ID":"c8836c14af0409d863d60cb41effd982","Type":"ContainerStarted","Data":"6e66ee694c5994ea53aafe0c1e533a8a44d24412031115abf96d78b293e64d96"} Oct 30 18:36:39.850280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.850209 2544 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 18:36:39.857309 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.857286 2544 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x8jf4" Oct 30 18:36:39.860513 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860450 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-host\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.860513 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860491 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.860742 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860537 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.860742 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860584 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shclp\" (UniqueName: \"kubernetes.io/projected/a3669583-9579-4c19-a246-8631b75c07f1-kube-api-access-shclp\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:39.860742 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860614 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-etc-kubernetes\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.860742 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860663 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-hosts-file\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:39.860742 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860689 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-systemd-units\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.860742 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860716 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.861082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860754 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-host-slash\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:39.861082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860794 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-agent-certs\") pod \"konnectivity-agent-9lgj6\" (UID: \"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e\") " pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:39.861082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860819 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-sys-fs\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.861082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860857 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-system-cni-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.861082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860882 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-hostroot\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.861082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.860921 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-config\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.861082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861011 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz9bj\" (UniqueName: \"kubernetes.io/projected/0826e146-9efa-405a-a894-32fd660477de-kube-api-access-dz9bj\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.861082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861037 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-kubernetes\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.861082 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861063 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-socket-dir-parent\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861090 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861114 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-kubelet\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861148 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-slash\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861192 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-iptables-alerter-script\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861218 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861242 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-tmp\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861267 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfm84\" (UniqueName: \"kubernetes.io/projected/252ce72d-90ff-43a0-a76c-6e68ab140aac-kube-api-access-dfm84\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861299 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861395 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-env-overrides\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861423 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-multus-certs\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861459 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-binary-copy\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861490 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wcbx\" (UniqueName: \"kubernetes.io/projected/e116b674-1f7e-448b-a3c4-08dd88c96ef4-kube-api-access-7wcbx\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861517 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-kubelet-config\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:39.861547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861545 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-cni-binary-copy\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861583 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-daemon-config\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861611 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861636 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-node-log\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861663 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-conf-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861687 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-conf\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861713 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-systemd\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861741 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-run\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861765 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-dbus\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861791 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-system-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861816 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-bin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861848 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3669583-9579-4c19-a246-8631b75c07f1-serviceca\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861878 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-var-lib-kubelet\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861905 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861929 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-sys\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.861955 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-k8s-cni-cncf-io\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862110 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-netns\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.862280 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862139 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpbg9\" (UniqueName: \"kubernetes.io/projected/d363b0f3-9797-404d-bbf7-f5860726934e-kube-api-access-rpbg9\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862168 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-tuned\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862196 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-tmp-dir\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862225 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-ovn\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862250 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-log-socket\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862276 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-script-lib\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862300 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-device-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862343 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-etc-selinux\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862368 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-bin\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862394 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-socket-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862421 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysconfig\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862448 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-kubelet\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862474 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-etc-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862501 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47fb71ba-fd5c-4279-8687-7954945eb63c-ovn-node-metrics-cert\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862528 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr5ln\" (UniqueName: \"kubernetes.io/projected/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-kube-api-access-pr5ln\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862555 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cnibin\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.863150 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862584 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862612 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862639 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-cnibin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862666 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-var-lib-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862693 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c76zg\" (UniqueName: \"kubernetes.io/projected/47fb71ba-fd5c-4279-8687-7954945eb63c-kube-api-access-c76zg\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862721 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-registration-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862748 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-systemd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.862783 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-lib-modules\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.863794 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.863837 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.863862 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvx46\" (UniqueName: \"kubernetes.io/projected/010093ae-c8f4-40f7-82eb-935febcb2c0b-kube-api-access-cvx46\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.863887 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4zhg\" (UniqueName: \"kubernetes.io/projected/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-kube-api-access-w4zhg\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:39.863977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.863971 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3669583-9579-4c19-a246-8631b75c07f1-host\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:39.864535 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.864029 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-multus\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.864535 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.864083 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-netd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.864535 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.864166 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-konnectivity-ca\") pod \"konnectivity-agent-9lgj6\" (UID: \"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e\") " pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:39.864535 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.864229 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-netns\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.864535 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.864283 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-modprobe-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.871223 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.871200 2544 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x8jf4" Oct 30 18:36:39.904663 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.904628 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 18:36:39.904876 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.904724 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 18:36:39.904876 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.904725 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 18:36:39.904876 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.904598 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 18:36:39.904876 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.904827 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 18:36:39.905137 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.904980 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 18:36:39.905137 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.905068 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 18:36:39.905239 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.905165 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rbclc\"" Oct 30 18:36:39.905239 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.905188 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 18:36:39.905322 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.905242 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 18:36:39.905322 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.905249 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 18:36:39.905322 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.905280 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 18:36:39.905447 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.905376 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7kr8g\"" Oct 30 18:36:39.905497 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.905445 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r66x4\"" Oct 30 18:36:39.905553 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.905541 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vr4rx\"" Oct 30 18:36:39.906397 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.906377 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 18:36:39.964715 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964677 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-sys\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.964895 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964723 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-k8s-cni-cncf-io\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.964895 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964755 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-netns\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.964895 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964783 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbg9\" (UniqueName: \"kubernetes.io/projected/d363b0f3-9797-404d-bbf7-f5860726934e-kube-api-access-rpbg9\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:39.964895 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964811 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-tuned\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.964895 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964837 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-tmp-dir\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:39.964895 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964854 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-sys\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.964895 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964866 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-k8s-cni-cncf-io\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.964895 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964862 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-ovn\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.965233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964901 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-ovn\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.965233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964949 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-log-socket\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.965233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.964969 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-netns\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.965233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965022 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-script-lib\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.965233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965078 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-log-socket\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.965233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965101 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-device-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.965233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965200 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-device-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965235 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-etc-selinux\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965311 2544 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965324 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-tmp-dir\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965350 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-bin\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965330 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-etc-selinux\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965376 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-socket-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965404 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysconfig\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965409 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-bin\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965430 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-kubelet\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965454 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-etc-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965479 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47fb71ba-fd5c-4279-8687-7954945eb63c-ovn-node-metrics-cert\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965504 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr5ln\" (UniqueName: \"kubernetes.io/projected/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-kube-api-access-pr5ln\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965509 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-socket-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965530 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cnibin\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965558 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-etc-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965559 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965601 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.966233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965629 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-cnibin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965656 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-var-lib-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965683 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c76zg\" (UniqueName: \"kubernetes.io/projected/47fb71ba-fd5c-4279-8687-7954945eb63c-kube-api-access-c76zg\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965708 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-registration-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965743 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-systemd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965753 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-script-lib\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965776 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-lib-modules\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965803 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965828 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965851 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvx46\" (UniqueName: \"kubernetes.io/projected/010093ae-c8f4-40f7-82eb-935febcb2c0b-kube-api-access-cvx46\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965876 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4zhg\" (UniqueName: \"kubernetes.io/projected/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-kube-api-access-w4zhg\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965903 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3669583-9579-4c19-a246-8631b75c07f1-host\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965925 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-multus\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.965968 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-netd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966008 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-konnectivity-ca\") pod \"konnectivity-agent-9lgj6\" (UID: \"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e\") " pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966037 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-netns\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966060 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-modprobe-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.966934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966083 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-host\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966106 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966130 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966135 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966157 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shclp\" (UniqueName: \"kubernetes.io/projected/a3669583-9579-4c19-a246-8631b75c07f1-kube-api-access-shclp\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966184 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-etc-kubernetes\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966225 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-hosts-file\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966251 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-systemd-units\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966278 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966304 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-host-slash\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966332 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-agent-certs\") pod \"konnectivity-agent-9lgj6\" (UID: \"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e\") " pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966355 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-sys-fs\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966378 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-system-cni-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966401 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-hostroot\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966426 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-config\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966433 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysconfig\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966455 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz9bj\" (UniqueName: \"kubernetes.io/projected/0826e146-9efa-405a-a894-32fd660477de-kube-api-access-dz9bj\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.967788 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966476 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-kubelet\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966482 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-kubernetes\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966523 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-socket-dir-parent\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966539 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-host-slash\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966554 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966582 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-kubelet\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966580 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-registration-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966611 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-slash\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966637 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-iptables-alerter-script\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966643 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-systemd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966665 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966687 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-tmp\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966725 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfm84\" (UniqueName: \"kubernetes.io/projected/252ce72d-90ff-43a0-a76c-6e68ab140aac-kube-api-access-dfm84\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966753 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966778 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966788 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-env-overrides\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966817 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-multus-certs\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.968637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966840 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-cnibin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966844 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3669583-9579-4c19-a246-8631b75c07f1-host\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966847 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-binary-copy\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966903 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-multus\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966917 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-var-lib-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966953 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-hostroot\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967021 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-system-cni-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967093 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-host\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.967127 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967141 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-netd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.967193 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret podName:3fcc356d-56b0-442e-a80e-6f9d4ad53362 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:40.467173538 +0000 UTC m=+3.051874237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret") pod "global-pull-secret-syncer-rsknn" (UID: "3fcc356d-56b0-442e-a80e-6f9d4ad53362") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967271 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967365 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967412 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-socket-dir-parent\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967491 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-config\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967567 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-kubelet\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967599 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-slash\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.969448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966606 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-lib-modules\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967767 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-konnectivity-ca\") pod \"konnectivity-agent-9lgj6\" (UID: \"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e\") " pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967786 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-netns\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967833 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967854 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-hosts-file\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966905 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wcbx\" (UniqueName: \"kubernetes.io/projected/e116b674-1f7e-448b-a3c4-08dd88c96ef4-kube-api-access-7wcbx\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967886 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-modprobe-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967898 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-kubelet-config\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.966191 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cnibin\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967929 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-kubernetes\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967931 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-cni-binary-copy\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967975 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-etc-kubernetes\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.967976 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-daemon-config\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968050 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968073 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-iptables-alerter-script\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968081 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-node-log\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968112 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-conf-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.970319 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968119 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-node-log\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968130 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-conf\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968148 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-systemd\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968161 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968165 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-run\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968204 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-dbus\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968232 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-system-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968251 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968260 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-bin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968290 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3669583-9579-4c19-a246-8631b75c07f1-serviceca\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968296 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-run\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968321 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-var-lib-kubelet\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968350 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.968462 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.968524 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:36:40.468509225 +0000 UTC m=+3.053209925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968575 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-dbus\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968627 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-system-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968673 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-bin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.971211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968826 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-sys-fs\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968939 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-systemd-units\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.968998 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969227 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-cni-binary-copy\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969299 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-kubelet-config\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969337 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-daemon-config\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969353 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969406 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-conf-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969488 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-conf\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969644 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-systemd\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969698 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-var-lib-kubelet\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969753 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-multus-certs\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969794 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-binary-copy\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.969920 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-env-overrides\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.970108 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-tuned\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.970256 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3669583-9579-4c19-a246-8631b75c07f1-serviceca\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.970318 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47fb71ba-fd5c-4279-8687-7954945eb63c-ovn-node-metrics-cert\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.972126 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.971992 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-agent-certs\") pod \"konnectivity-agent-9lgj6\" (UID: \"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e\") " pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:39.973463 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.973439 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-tmp\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.989011 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.988932 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:36:39.989011 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.988961 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:36:39.989011 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.988975 2544 projected.go:196] Error preparing data for projected volume kube-api-access-m9g9j for pod openshift-network-diagnostics/network-check-target-r8cj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:39.990000 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:39.989867 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j podName:a74100cb-b82a-4e6b-a764-c2f090c71913 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:40.489841621 +0000 UTC m=+3.074542350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m9g9j" (UniqueName: "kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j") pod "network-check-target-r8cj4" (UID: "a74100cb-b82a-4e6b-a764-c2f090c71913") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:39.991597 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.991136 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c76zg\" (UniqueName: \"kubernetes.io/projected/47fb71ba-fd5c-4279-8687-7954945eb63c-kube-api-access-c76zg\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:39.991597 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.991505 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr5ln\" (UniqueName: \"kubernetes.io/projected/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-kube-api-access-pr5ln\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:39.993155 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.993098 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbg9\" (UniqueName: \"kubernetes.io/projected/d363b0f3-9797-404d-bbf7-f5860726934e-kube-api-access-rpbg9\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:39.993386 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.993290 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4zhg\" (UniqueName: \"kubernetes.io/projected/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-kube-api-access-w4zhg\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:39.993386 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.993368 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shclp\" (UniqueName: \"kubernetes.io/projected/a3669583-9579-4c19-a246-8631b75c07f1-kube-api-access-shclp\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:39.994039 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.993556 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvx46\" (UniqueName: \"kubernetes.io/projected/010093ae-c8f4-40f7-82eb-935febcb2c0b-kube-api-access-cvx46\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:36:39.994039 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.993829 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfm84\" (UniqueName: \"kubernetes.io/projected/252ce72d-90ff-43a0-a76c-6e68ab140aac-kube-api-access-dfm84\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:39.994039 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.993898 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz9bj\" (UniqueName: \"kubernetes.io/projected/0826e146-9efa-405a-a894-32fd660477de-kube-api-access-dz9bj\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:39.995549 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:39.995524 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wcbx\" (UniqueName: \"kubernetes.io/projected/e116b674-1f7e-448b-a3c4-08dd88c96ef4-kube-api-access-7wcbx\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:40.093735 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.093685 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9n4ts" Oct 30 18:36:40.102559 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.102526 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:36:40.106055 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:40.106020 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010093ae_c8f4_40f7_82eb_935febcb2c0b.slice/crio-2a5b2f327225da8f4f4fdb7e8f8db4ae8ee1b702ed8be9524063cc5f31a0fa19 WatchSource:0}: Error finding container 2a5b2f327225da8f4f4fdb7e8f8db4ae8ee1b702ed8be9524063cc5f31a0fa19: Status 404 returned error can't find the container with id 2a5b2f327225da8f4f4fdb7e8f8db4ae8ee1b702ed8be9524063cc5f31a0fa19 Oct 30 18:36:40.113613 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.113582 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:36:40.113718 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:40.113678 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e3ad3c_91c2_4f6b_9b36_250d4e28bba0.slice/crio-8805a204224312afc8ddd67e833de3ee909190d75b71a2c3a5ccdf2ab7f08870 WatchSource:0}: Error finding container 8805a204224312afc8ddd67e833de3ee909190d75b71a2c3a5ccdf2ab7f08870: Status 404 returned error can't find the container with id 8805a204224312afc8ddd67e833de3ee909190d75b71a2c3a5ccdf2ab7f08870 Oct 30 18:36:40.120107 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.120071 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:40.126117 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:40.126086 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba11b962_ce4c_4b4a_9b1f_19ac22a0613b.slice/crio-b78dedc6a3adba0ed3c7ef78f1a1b33ce34f538db385d6f158b619b618b63077 WatchSource:0}: Error finding container b78dedc6a3adba0ed3c7ef78f1a1b33ce34f538db385d6f158b619b618b63077: Status 404 returned error can't find the container with id b78dedc6a3adba0ed3c7ef78f1a1b33ce34f538db385d6f158b619b618b63077 Oct 30 18:36:40.132545 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:40.132520 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9ff6a4_3e7d_4c9a_9f14_b4fa6ef8f78e.slice/crio-e42b60cfb5b92f48e4818926d5a4a4eff2a3ab4f777fdb645983adcdc56024ae WatchSource:0}: Error finding container e42b60cfb5b92f48e4818926d5a4a4eff2a3ab4f777fdb645983adcdc56024ae: Status 404 returned error can't find the container with id e42b60cfb5b92f48e4818926d5a4a4eff2a3ab4f777fdb645983adcdc56024ae Oct 30 18:36:40.134727 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.134708 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:36:40.138924 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.138783 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:36:40.147231 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:40.147200 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0826e146_9efa_405a_a894_32fd660477de.slice/crio-75db4be93b5a4c982817bab69acff25aef4b27342e73e62028581aad8b0520a5 WatchSource:0}: Error finding container 75db4be93b5a4c982817bab69acff25aef4b27342e73e62028581aad8b0520a5: Status 404 returned error can't find the container with id 75db4be93b5a4c982817bab69acff25aef4b27342e73e62028581aad8b0520a5 Oct 30 18:36:40.148368 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.148345 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:36:40.149715 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:40.149695 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3669583_9579_4c19_a246_8631b75c07f1.slice/crio-be2db8ca846cac53ab74c5a5471a0577da1c7bb52cd9c1eabe1aa8eab2006e65 WatchSource:0}: Error finding container be2db8ca846cac53ab74c5a5471a0577da1c7bb52cd9c1eabe1aa8eab2006e65: Status 404 returned error can't find the container with id be2db8ca846cac53ab74c5a5471a0577da1c7bb52cd9c1eabe1aa8eab2006e65 Oct 30 18:36:40.162974 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:40.162930 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252ce72d_90ff_43a0_a76c_6e68ab140aac.slice/crio-ebec83b79d595d0ae4b8bd2d2235a7cb19c3ba10836965789110688603bc78fd WatchSource:0}: Error finding container ebec83b79d595d0ae4b8bd2d2235a7cb19c3ba10836965789110688603bc78fd: Status 404 returned error can't find the container with id ebec83b79d595d0ae4b8bd2d2235a7cb19c3ba10836965789110688603bc78fd Oct 30 18:36:40.175111 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.175085 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:36:40.185491 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:40.185455 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode116b674_1f7e_448b_a3c4_08dd88c96ef4.slice/crio-cb7727a15c10a80eece2ba1c3d5080d0f32711e520e5304b82300d3ac0248f60 WatchSource:0}: Error finding container cb7727a15c10a80eece2ba1c3d5080d0f32711e520e5304b82300d3ac0248f60: Status 404 returned error can't find the container with id cb7727a15c10a80eece2ba1c3d5080d0f32711e520e5304b82300d3ac0248f60 Oct 30 18:36:40.189547 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.189374 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:36:40.201152 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:36:40.201123 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47fb71ba_fd5c_4279_8687_7954945eb63c.slice/crio-610d4422a75555b64d03323693c04b6dbfd7478fce6c90f24fe35288f3558c4b WatchSource:0}: Error finding container 610d4422a75555b64d03323693c04b6dbfd7478fce6c90f24fe35288f3558c4b: Status 404 returned error can't find the container with id 610d4422a75555b64d03323693c04b6dbfd7478fce6c90f24fe35288f3558c4b Oct 30 18:36:40.301664 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.301633 2544 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:36:40.473007 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.472976 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:40.473171 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.473030 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:40.473171 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:40.473146 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:40.473285 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:40.473207 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret podName:3fcc356d-56b0-442e-a80e-6f9d4ad53362 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:41.473191378 +0000 UTC m=+4.057892088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret") pod "global-pull-secret-syncer-rsknn" (UID: "3fcc356d-56b0-442e-a80e-6f9d4ad53362") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:40.473650 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:40.473595 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:40.473747 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:40.473656 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:36:41.473637425 +0000 UTC m=+4.058338127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:40.573442 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.573344 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:40.573567 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:40.573540 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:36:40.573640 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:40.573574 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:36:40.573640 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:40.573589 2544 projected.go:196] Error preparing data for projected volume kube-api-access-m9g9j for pod openshift-network-diagnostics/network-check-target-r8cj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:40.573719 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:40.573651 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j podName:a74100cb-b82a-4e6b-a764-c2f090c71913 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:41.573630948 +0000 UTC m=+4.158331665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9g9j" (UniqueName: "kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j") pod "network-check-target-r8cj4" (UID: "a74100cb-b82a-4e6b-a764-c2f090c71913") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:40.850038 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.849297 2544 generic.go:356] "Generic (PLEG): container finished" podID="c8836c14af0409d863d60cb41effd982" containerID="241087f575aa4759a0e5773542351931597bc51f3c157d5621068047a5c99be0" exitCode=0 Oct 30 18:36:40.850038 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.849404 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" event={"ID":"c8836c14af0409d863d60cb41effd982","Type":"ContainerDied","Data":"241087f575aa4759a0e5773542351931597bc51f3c157d5621068047a5c99be0"} Oct 30 18:36:40.852166 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.852057 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64wt" event={"ID":"e116b674-1f7e-448b-a3c4-08dd88c96ef4","Type":"ContainerStarted","Data":"cb7727a15c10a80eece2ba1c3d5080d0f32711e520e5304b82300d3ac0248f60"} Oct 30 18:36:40.854489 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.854406 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2cklg" event={"ID":"252ce72d-90ff-43a0-a76c-6e68ab140aac","Type":"ContainerStarted","Data":"ebec83b79d595d0ae4b8bd2d2235a7cb19c3ba10836965789110688603bc78fd"} Oct 30 18:36:40.858392 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.857631 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kbg25" event={"ID":"a3669583-9579-4c19-a246-8631b75c07f1","Type":"ContainerStarted","Data":"be2db8ca846cac53ab74c5a5471a0577da1c7bb52cd9c1eabe1aa8eab2006e65"} Oct 30 18:36:40.874644 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.874431 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9lgj6" event={"ID":"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e","Type":"ContainerStarted","Data":"e42b60cfb5b92f48e4818926d5a4a4eff2a3ab4f777fdb645983adcdc56024ae"} Oct 30 18:36:40.874644 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.874539 2544 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:31:40 +0000 UTC" deadline="2028-07-27 11:48:47.941023784 +0000 UTC" Oct 30 18:36:40.874644 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.874589 2544 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15257h12m7.0664392s" Oct 30 18:36:40.887795 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.887767 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zl8dn" event={"ID":"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b","Type":"ContainerStarted","Data":"b78dedc6a3adba0ed3c7ef78f1a1b33ce34f538db385d6f158b619b618b63077"} Oct 30 18:36:40.916588 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.916492 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bvrtd" event={"ID":"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0","Type":"ContainerStarted","Data":"8805a204224312afc8ddd67e833de3ee909190d75b71a2c3a5ccdf2ab7f08870"} Oct 30 18:36:40.922489 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.921738 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" event={"ID":"ac0cf868632d3632743a3feebbcd95ab","Type":"ContainerStarted","Data":"63ee6ab62b9632255cd2735a7be9c60d271ea77f2e270ac6699427f82a7f32e3"} Oct 30 18:36:40.927368 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.927278 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" event={"ID":"47fb71ba-fd5c-4279-8687-7954945eb63c","Type":"ContainerStarted","Data":"610d4422a75555b64d03323693c04b6dbfd7478fce6c90f24fe35288f3558c4b"} Oct 30 18:36:40.940141 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.940112 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" event={"ID":"0826e146-9efa-405a-a894-32fd660477de","Type":"ContainerStarted","Data":"75db4be93b5a4c982817bab69acff25aef4b27342e73e62028581aad8b0520a5"} Oct 30 18:36:40.955755 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:40.955720 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9n4ts" event={"ID":"010093ae-c8f4-40f7-82eb-935febcb2c0b","Type":"ContainerStarted","Data":"2a5b2f327225da8f4f4fdb7e8f8db4ae8ee1b702ed8be9524063cc5f31a0fa19"} Oct 30 18:36:41.481653 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:41.481614 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:41.481963 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:41.481683 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:41.481963 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.481832 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:41.481963 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.481895 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret podName:3fcc356d-56b0-442e-a80e-6f9d4ad53362 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:43.481876385 +0000 UTC m=+6.066577099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret") pod "global-pull-secret-syncer-rsknn" (UID: "3fcc356d-56b0-442e-a80e-6f9d4ad53362") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:41.482434 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.482327 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:41.482434 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.482389 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:36:43.482371843 +0000 UTC m=+6.067072555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:41.529637 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:41.529446 2544 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:36:41.582277 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:41.582229 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:41.582496 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.582479 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:36:41.582548 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.582509 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:36:41.582548 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.582524 2544 projected.go:196] Error preparing data for projected volume kube-api-access-m9g9j for pod openshift-network-diagnostics/network-check-target-r8cj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:41.582651 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.582591 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j podName:a74100cb-b82a-4e6b-a764-c2f090c71913 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:43.582571825 +0000 UTC m=+6.167272528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9g9j" (UniqueName: "kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j") pod "network-check-target-r8cj4" (UID: "a74100cb-b82a-4e6b-a764-c2f090c71913") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:41.819221 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:41.819134 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:41.819221 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:41.819212 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:41.819221 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:41.819213 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:41.819519 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.819331 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:41.819519 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.819428 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:41.819610 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:41.819531 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:36:41.875536 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:41.875491 2544 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:31:40 +0000 UTC" deadline="2028-05-23 06:35:56.76376103 +0000 UTC" Oct 30 18:36:41.875536 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:41.875534 2544 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13691h59m14.888231482s" Oct 30 18:36:41.981790 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:41.980803 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" event={"ID":"c8836c14af0409d863d60cb41effd982","Type":"ContainerStarted","Data":"8ad3b0b7d44eb2bbdb22d691d8de29af6c8024af0dd5d8914d61603cf6ff1f83"} Oct 30 18:36:42.028009 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:42.024230 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" podStartSLOduration=3.02420612 podStartE2EDuration="3.02420612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:42.023180925 +0000 UTC m=+4.607881649" watchObservedRunningTime="2026-10-30 18:36:42.02420612 +0000 UTC m=+4.608906842" Oct 30 18:36:42.028009 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:42.025676 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" podStartSLOduration=3.025656523 podStartE2EDuration="3.025656523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:40.965075399 +0000 UTC m=+3.549776124" watchObservedRunningTime="2026-10-30 18:36:42.025656523 +0000 UTC m=+4.610357247" Oct 30 18:36:43.502581 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:43.501753 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:43.502581 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:43.501846 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:43.502581 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.502014 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:43.502581 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.502079 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:36:47.502059412 +0000 UTC m=+10.086760132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:43.502581 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.502493 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:43.502581 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.502542 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret podName:3fcc356d-56b0-442e-a80e-6f9d4ad53362 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:47.502527285 +0000 UTC m=+10.087227999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret") pod "global-pull-secret-syncer-rsknn" (UID: "3fcc356d-56b0-442e-a80e-6f9d4ad53362") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:43.603169 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:43.602624 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:43.603169 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.602752 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:36:43.603169 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.602765 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:36:43.603169 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.602775 2544 projected.go:196] Error preparing data for projected volume kube-api-access-m9g9j for pod openshift-network-diagnostics/network-check-target-r8cj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:43.603169 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.602821 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j podName:a74100cb-b82a-4e6b-a764-c2f090c71913 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:47.602808306 +0000 UTC m=+10.187509020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9g9j" (UniqueName: "kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j") pod "network-check-target-r8cj4" (UID: "a74100cb-b82a-4e6b-a764-c2f090c71913") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:43.821846 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:43.821768 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:43.822014 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.821948 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:36:43.822379 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:43.822356 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:43.822497 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.822463 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:43.822563 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:43.822519 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:43.822617 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:43.822574 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:43.989257 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:43.989221 2544 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="aa3b56130e045d617bf926ac6acbdc377fef69ec4677baf3c3e99b691fc52e49" exitCode=0 Oct 30 18:36:43.989420 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:43.989271 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64wt" event={"ID":"e116b674-1f7e-448b-a3c4-08dd88c96ef4","Type":"ContainerDied","Data":"aa3b56130e045d617bf926ac6acbdc377fef69ec4677baf3c3e99b691fc52e49"} Oct 30 18:36:44.997783 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:44.997731 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9lgj6" event={"ID":"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e","Type":"ContainerStarted","Data":"1b9693fd7807b660a4a228303d67f4b4a7bfd5a177f31c0071681f08f20aaa42"} Oct 30 18:36:45.822424 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:45.822030 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:45.822424 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:45.822167 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:45.822424 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:45.822179 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:45.822424 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:45.822281 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:45.822424 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:45.822282 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:45.822424 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:45.822374 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:36:46.011173 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:46.011141 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kbg25" event={"ID":"a3669583-9579-4c19-a246-8631b75c07f1","Type":"ContainerStarted","Data":"1ee8498440bc1e248973c3a4a950d8ec73b39d07809807932f58d5027b598e1f"} Oct 30 18:36:46.059520 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:46.059256 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9lgj6" podStartSLOduration=4.044227529 podStartE2EDuration="8.059236859s" totalImagesPullingTime="4.01500933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:45.037655097 +0000 UTC m=+7.622355816" watchObservedRunningTime="2026-10-30 18:36:46.059236859 +0000 UTC m=+8.643937580" Oct 30 18:36:46.060229 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:46.060154 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kbg25" podStartSLOduration=3.341134013 podStartE2EDuration="8.060138008s" totalImagesPullingTime="4.719003995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:46.059597657 +0000 UTC m=+8.644298379" watchObservedRunningTime="2026-10-30 18:36:46.060138008 +0000 UTC m=+8.644838725" Oct 30 18:36:47.018614 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.018579 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" event={"ID":"0826e146-9efa-405a-a894-32fd660477de","Type":"ContainerStarted","Data":"4560ec0ff8ea314eba210022c89b930b82100b6780c503bbc4ab959b46d5120d"} Oct 30 18:36:47.536870 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.536832 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:47.537062 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.536883 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:47.537062 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.537030 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:47.537158 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.537095 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret podName:3fcc356d-56b0-442e-a80e-6f9d4ad53362 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:55.537076825 +0000 UTC m=+18.121777542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret") pod "global-pull-secret-syncer-rsknn" (UID: "3fcc356d-56b0-442e-a80e-6f9d4ad53362") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:47.537501 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.537481 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:47.537587 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.537539 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:36:55.537523136 +0000 UTC m=+18.122223847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:47.637894 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.637855 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:47.638237 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.638112 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:36:47.638237 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.638135 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:36:47.638237 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.638148 2544 projected.go:196] Error preparing data for projected volume kube-api-access-m9g9j for pod openshift-network-diagnostics/network-check-target-r8cj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:47.638237 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.638209 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j podName:a74100cb-b82a-4e6b-a764-c2f090c71913 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:55.638191005 +0000 UTC m=+18.222891704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9g9j" (UniqueName: "kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j") pod "network-check-target-r8cj4" (UID: "a74100cb-b82a-4e6b-a764-c2f090c71913") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:47.661440 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.661413 2544 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 18:36:47.810335 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.810242 2544 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T18:36:47.661437071Z","UUID":"c66a6e58-764c-494b-b87d-d10c6cfe6042","Handler":null,"Name":"","Endpoint":""} Oct 30 18:36:47.817654 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.816348 2544 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 18:36:47.817654 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.816378 2544 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 18:36:47.821389 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.821370 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:47.823669 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.821615 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:47.823669 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:47.821661 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:47.824671 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.824272 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:47.824671 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.824622 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:47.825081 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:47.825044 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:36:48.023077 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:48.023003 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" event={"ID":"0826e146-9efa-405a-a894-32fd660477de","Type":"ContainerStarted","Data":"730608bd69e7be54f00f90fa14572f771e3204824704d4b399c3dc1015bd889b"} Oct 30 18:36:49.029202 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.028950 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bvrtd" event={"ID":"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0","Type":"ContainerStarted","Data":"bd39578b5dc8425bb87bffce95ed98e75308bee0301b68fe257388edbb2112b4"} Oct 30 18:36:49.031797 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.031766 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" event={"ID":"0826e146-9efa-405a-a894-32fd660477de","Type":"ContainerStarted","Data":"2ab03822b9fb9d18957af6bc6bb3046204d8f1cdc86b45ff824361e5a6e4336b"} Oct 30 18:36:49.033694 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.033661 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9n4ts" event={"ID":"010093ae-c8f4-40f7-82eb-935febcb2c0b","Type":"ContainerStarted","Data":"f8d55e8ee8370c51ad93b884ca4f445a82e999ad32b98833a510d7bee59b4b6c"} Oct 30 18:36:49.036009 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.035974 2544 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="78ca8419ee29a7a949ea61bd54e2eda4d53270522c11518a088c24eb2211de14" exitCode=0 Oct 30 18:36:49.036148 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.036020 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64wt" event={"ID":"e116b674-1f7e-448b-a3c4-08dd88c96ef4","Type":"ContainerDied","Data":"78ca8419ee29a7a949ea61bd54e2eda4d53270522c11518a088c24eb2211de14"} Oct 30 18:36:49.067899 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.067843 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-bvrtd" podStartSLOduration=3.061415869 podStartE2EDuration="11.067826143s" totalImagesPullingTime="8.006410274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:49.067195016 +0000 UTC m=+11.651895737" watchObservedRunningTime="2026-10-30 18:36:49.067826143 +0000 UTC m=+11.652526863" Oct 30 18:36:49.106608 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.106555 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" podStartSLOduration=3.017509357 podStartE2EDuration="11.106541201s" totalImagesPullingTime="8.089031844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:49.105993222 +0000 UTC m=+11.690693944" watchObservedRunningTime="2026-10-30 18:36:49.106541201 +0000 UTC m=+11.691241922" Oct 30 18:36:49.755929 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.755185 2544 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:49.755929 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.755322 2544 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:49.793393 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.793333 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-9n4ts" podStartSLOduration=3.865753115 podStartE2EDuration="11.793314104s" totalImagesPullingTime="7.927560989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:49.187642261 +0000 UTC m=+11.772342981" watchObservedRunningTime="2026-10-30 18:36:49.793314104 +0000 UTC m=+12.378014824" Oct 30 18:36:49.819854 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.819778 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:49.820028 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.819789 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:49.820028 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:49.819930 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:49.820028 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:49.819938 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:36:49.820028 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:49.820002 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:49.820230 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:49.820074 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:50.040475 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:50.040404 2544 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="2961c877658640bbe119d028929ec29b28a699d9aa997396040c4aa21c4ddc0d" exitCode=0 Oct 30 18:36:50.041008 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:50.040499 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64wt" event={"ID":"e116b674-1f7e-448b-a3c4-08dd88c96ef4","Type":"ContainerDied","Data":"2961c877658640bbe119d028929ec29b28a699d9aa997396040c4aa21c4ddc0d"} Oct 30 18:36:50.042780 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:50.042758 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zl8dn" event={"ID":"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b","Type":"ContainerStarted","Data":"75a767d670571f8d8ad4b2b80d7f4dbbeb0c856c408051532093c92448f692c8"} Oct 30 18:36:51.048089 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:51.047992 2544 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="1c8acaa03cf5e3be9f19a3292d0853b0165f949ad12df3d8ec6084d741ff9ccc" exitCode=0 Oct 30 18:36:51.048811 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:51.048088 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64wt" event={"ID":"e116b674-1f7e-448b-a3c4-08dd88c96ef4","Type":"ContainerDied","Data":"1c8acaa03cf5e3be9f19a3292d0853b0165f949ad12df3d8ec6084d741ff9ccc"} Oct 30 18:36:51.050192 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:51.050127 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2cklg" event={"ID":"252ce72d-90ff-43a0-a76c-6e68ab140aac","Type":"ContainerStarted","Data":"66d7ad819498ba85c9114f3e7d4883286c49a0b6838f0d87d2c2f7724e55f724"} Oct 30 18:36:51.090993 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:51.090946 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zl8dn" podStartSLOduration=5.46513889 podStartE2EDuration="13.090932834s" totalImagesPullingTime="7.625793944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:50.124046154 +0000 UTC m=+12.708746872" watchObservedRunningTime="2026-10-30 18:36:51.090932834 +0000 UTC m=+13.675633553" Oct 30 18:36:51.135387 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:51.135335 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2cklg" podStartSLOduration=2.994412883 podStartE2EDuration="13.135316626s" totalImagesPullingTime="10.140903743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:51.134526242 +0000 UTC m=+13.719226960" watchObservedRunningTime="2026-10-30 18:36:51.135316626 +0000 UTC m=+13.720017350" Oct 30 18:36:51.818834 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:51.818802 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:51.819011 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:51.818844 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:51.819011 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:51.818800 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:51.819011 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:51.818971 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:36:51.819142 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:51.819070 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:51.819142 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:51.819133 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:53.057878 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:53.057550 2544 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="9105c6b4cbf9229e0daab09ebd2ef35b3c46b462e03d3e9603c083e0105b7a90" exitCode=0 Oct 30 18:36:53.057878 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:53.057631 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64wt" event={"ID":"e116b674-1f7e-448b-a3c4-08dd88c96ef4","Type":"ContainerDied","Data":"9105c6b4cbf9229e0daab09ebd2ef35b3c46b462e03d3e9603c083e0105b7a90"} Oct 30 18:36:53.819428 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:53.819396 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:53.819428 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:53.819419 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:53.819694 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:53.819521 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:53.819694 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:53.819617 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:53.819694 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:53.819688 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:53.819856 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:53.819775 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:36:54.064102 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:54.064067 2544 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="718468a4bb70edb445ac001f00448b2064e9c24c983c1db58c01f785b0d2b508" exitCode=0 Oct 30 18:36:54.064517 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:54.064122 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64wt" event={"ID":"e116b674-1f7e-448b-a3c4-08dd88c96ef4","Type":"ContainerDied","Data":"718468a4bb70edb445ac001f00448b2064e9c24c983c1db58c01f785b0d2b508"} Oct 30 18:36:55.068889 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.068723 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" event={"ID":"47fb71ba-fd5c-4279-8687-7954945eb63c","Type":"ContainerStarted","Data":"1fc958350c50013a1b38aaf3e0ca7d768a433cda65d1dd334c222d6b532d6a29"} Oct 30 18:36:55.069258 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.068965 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" event={"ID":"47fb71ba-fd5c-4279-8687-7954945eb63c","Type":"ContainerStarted","Data":"31b4c4214a969d668b6e3f351ac84770bfd9ac9c06780340120f1fb8418c52e8"} Oct 30 18:36:55.069258 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.069003 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" event={"ID":"47fb71ba-fd5c-4279-8687-7954945eb63c","Type":"ContainerStarted","Data":"70639938e74fd7787af0a0ec5c4c91030bbf30080bf56be69e4e2f0cf8547e69"} Oct 30 18:36:55.069258 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.069045 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" event={"ID":"47fb71ba-fd5c-4279-8687-7954945eb63c","Type":"ContainerStarted","Data":"b21f09dc6adc6a40ca1562ce0ed9045d70e1222194369f2796b3fdf0fd6db41c"} Oct 30 18:36:55.074431 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.074406 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64wt" event={"ID":"e116b674-1f7e-448b-a3c4-08dd88c96ef4","Type":"ContainerStarted","Data":"b24b66582dd944f594d50f5d708da698c823445481d00fb3f7d2ee57e4b72496"} Oct 30 18:36:55.149860 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.149801 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d64wt" podStartSLOduration=7.384413579 podStartE2EDuration="17.149783414s" totalImagesPullingTime="9.765369835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:55.149520066 +0000 UTC m=+17.734220785" watchObservedRunningTime="2026-10-30 18:36:55.149783414 +0000 UTC m=+17.734484134" Oct 30 18:36:55.605392 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.605341 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:55.605392 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.605397 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:55.605651 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.605493 2544 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:55.605651 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.605511 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:55.605651 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.605542 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret podName:3fcc356d-56b0-442e-a80e-6f9d4ad53362 nodeName:}" failed. No retries permitted until 2026-10-30 18:37:11.60553044 +0000 UTC m=+34.190231138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret") pod "global-pull-secret-syncer-rsknn" (UID: "3fcc356d-56b0-442e-a80e-6f9d4ad53362") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:36:55.605651 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.605561 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:11.605548856 +0000 UTC m=+34.190249571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:36:55.706303 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.706271 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:55.706489 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.706467 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:36:55.706580 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.706499 2544 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:36:55.706580 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.706513 2544 projected.go:196] Error preparing data for projected volume kube-api-access-m9g9j for pod openshift-network-diagnostics/network-check-target-r8cj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:55.706580 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.706579 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j podName:a74100cb-b82a-4e6b-a764-c2f090c71913 nodeName:}" failed. No retries permitted until 2026-10-30 18:37:11.706559069 +0000 UTC m=+34.291259767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9g9j" (UniqueName: "kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j") pod "network-check-target-r8cj4" (UID: "a74100cb-b82a-4e6b-a764-c2f090c71913") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:36:55.818957 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.818926 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:55.819122 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.819025 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:55.819122 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.819044 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:55.819224 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:55.818933 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:55.819224 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.819123 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:55.819351 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:55.819221 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:36:56.079441 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:56.079408 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" event={"ID":"47fb71ba-fd5c-4279-8687-7954945eb63c","Type":"ContainerStarted","Data":"c308dfcf269eda05f6f240bf62639c725e1027f7cfbfd2b47a4cde959a23d917"} Oct 30 18:36:56.079814 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:56.079474 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" event={"ID":"47fb71ba-fd5c-4279-8687-7954945eb63c","Type":"ContainerStarted","Data":"01436d24c18cbafd30f353782193775abab7e5b79b3e7c531eeda674af44230d"} Oct 30 18:36:57.401537 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:57.401496 2544 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:57.402064 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:57.401607 2544 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 18:36:57.402203 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:57.402189 2544 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:36:57.820049 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:57.820022 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:57.820186 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:57.820099 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:57.820186 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:57.820110 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:57.820272 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:57.820232 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:36:57.820315 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:57.820279 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:57.820373 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:57.820356 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:58.087059 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:58.086977 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" event={"ID":"47fb71ba-fd5c-4279-8687-7954945eb63c","Type":"ContainerStarted","Data":"d2ae4194815c54a4a52764f4993b65b2d67b0d0136ff0a66854be65ab9a02e64"} Oct 30 18:36:59.819143 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:59.819108 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:36:59.819920 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:59.819157 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:36:59.819920 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:36:59.819173 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:36:59.819920 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:59.819267 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:36:59.819920 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:59.819310 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:36:59.819920 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:36:59.819411 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:37:00.095508 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:00.095425 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" event={"ID":"47fb71ba-fd5c-4279-8687-7954945eb63c","Type":"ContainerStarted","Data":"c9fad220693b43b148a854b2d179fb2406e3d2026220b12bb7ce2a28c31f910d"} Oct 30 18:37:00.095665 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:00.095649 2544 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:00.111168 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:00.111140 2544 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:00.181496 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:00.181446 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" podStartSLOduration=7.56392424 podStartE2EDuration="22.181434285s" totalImagesPullingTime="14.617510045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:00.180668981 +0000 UTC m=+22.765369679" watchObservedRunningTime="2026-10-30 18:37:00.181434285 +0000 UTC m=+22.766135003" Oct 30 18:37:01.098480 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:01.098328 2544 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:01.098919 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:01.098886 2544 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:01.113213 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:01.113191 2544 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:01.298799 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:01.298680 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fkxqh"] Oct 30 18:37:01.298938 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:01.298823 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:01.298992 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:01.298931 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:37:01.299512 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:01.299483 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8cj4"] Oct 30 18:37:01.299606 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:01.299564 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:01.299638 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:01.299627 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:37:01.300752 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:01.300735 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rsknn"] Oct 30 18:37:01.300819 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:01.300806 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:01.300878 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:01.300865 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:37:02.818687 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:02.818662 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:02.819144 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:02.818663 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:02.819144 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:02.818756 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:37:02.819144 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:02.818665 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:02.819144 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:02.818847 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:37:02.819144 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:02.818953 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:37:04.819703 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:04.819668 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:04.819703 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:04.819696 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:04.820305 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:04.819708 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:04.820305 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:04.819777 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:37:04.820305 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:04.819836 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:37:04.820305 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:04.819929 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:37:06.819489 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:06.819404 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:06.819896 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:06.819417 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:06.819896 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:06.819557 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkxqh" podUID="d363b0f3-9797-404d-bbf7-f5860726934e" Oct 30 18:37:06.819896 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:06.819427 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:06.819896 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:06.819589 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8cj4" podUID="a74100cb-b82a-4e6b-a764-c2f090c71913" Oct 30 18:37:06.819896 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:06.819686 2544 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rsknn" podUID="3fcc356d-56b0-442e-a80e-6f9d4ad53362" Oct 30 18:37:07.689022 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.688997 2544 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeReady" Oct 30 18:37:07.689191 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.689120 2544 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 18:37:07.747418 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.747394 2544 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5xf4w"] Oct 30 18:37:07.751108 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.751084 2544 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4mcxv"] Oct 30 18:37:07.751246 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.751226 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.754209 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.754191 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:07.769571 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.769537 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5xf4w"] Oct 30 18:37:07.772538 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.772520 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4mcxv"] Oct 30 18:37:07.782099 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.782077 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 18:37:07.782566 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.782080 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6dtmn\"" Oct 30 18:37:07.782566 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.782419 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 18:37:07.782566 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.782544 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 18:37:07.785225 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.785198 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-vjc5x\"" Oct 30 18:37:07.785225 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.785220 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 18:37:07.785365 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.785245 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 18:37:07.890036 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.890009 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc45g\" (UniqueName: \"kubernetes.io/projected/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-kube-api-access-hc45g\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.890382 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.890043 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-config-volume\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.890382 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.890062 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnlvv\" (UniqueName: \"kubernetes.io/projected/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-kube-api-access-rnlvv\") pod \"ingress-canary-4mcxv\" (UID: \"5fe7ce49-5f2c-4057-b653-6f20a1eae46f\") " pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:07.890382 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.890132 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.890382 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.890160 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-cert\") pod \"ingress-canary-4mcxv\" (UID: \"5fe7ce49-5f2c-4057-b653-6f20a1eae46f\") " pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:07.890382 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.890195 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-tmp-dir\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.991635 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.991551 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc45g\" (UniqueName: \"kubernetes.io/projected/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-kube-api-access-hc45g\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.991635 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.991601 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-config-volume\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.991848 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.991724 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnlvv\" (UniqueName: \"kubernetes.io/projected/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-kube-api-access-rnlvv\") pod \"ingress-canary-4mcxv\" (UID: \"5fe7ce49-5f2c-4057-b653-6f20a1eae46f\") " pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:07.991848 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.991784 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.991848 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.991809 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-cert\") pod \"ingress-canary-4mcxv\" (UID: \"5fe7ce49-5f2c-4057-b653-6f20a1eae46f\") " pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:07.991848 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.991841 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-tmp-dir\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.992088 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:07.991960 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:37:07.992088 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:07.992032 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls podName:f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:08.492016664 +0000 UTC m=+31.076717380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls") pod "dns-default-5xf4w" (UID: "f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e") : secret "dns-default-metrics-tls" not found Oct 30 18:37:07.992197 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.992174 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-tmp-dir\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.992348 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.992325 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-config-volume\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:07.995636 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:07.995614 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-cert\") pod \"ingress-canary-4mcxv\" (UID: \"5fe7ce49-5f2c-4057-b653-6f20a1eae46f\") " pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:08.020215 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.020181 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnlvv\" (UniqueName: \"kubernetes.io/projected/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-kube-api-access-rnlvv\") pod \"ingress-canary-4mcxv\" (UID: \"5fe7ce49-5f2c-4057-b653-6f20a1eae46f\") " pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:08.025934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.025898 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc45g\" (UniqueName: \"kubernetes.io/projected/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-kube-api-access-hc45g\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:08.071621 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.071590 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:08.382282 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.382204 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4mcxv"] Oct 30 18:37:08.386001 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:37:08.385977 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe7ce49_5f2c_4057_b653_6f20a1eae46f.slice/crio-32ea5fe144e64d9aa8a52125fbf5399b84e1882f63a7569223f2a7ee64dc8d3f WatchSource:0}: Error finding container 32ea5fe144e64d9aa8a52125fbf5399b84e1882f63a7569223f2a7ee64dc8d3f: Status 404 returned error can't find the container with id 32ea5fe144e64d9aa8a52125fbf5399b84e1882f63a7569223f2a7ee64dc8d3f Oct 30 18:37:08.496720 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.496694 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:08.496851 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:08.496840 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:37:08.496927 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:08.496898 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls podName:f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:09.496883153 +0000 UTC m=+32.081583851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls") pod "dns-default-5xf4w" (UID: "f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e") : secret "dns-default-metrics-tls" not found Oct 30 18:37:08.818902 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.818865 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:08.819098 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.819014 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:08.819233 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.818883 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:08.835850 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.835821 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 18:37:08.835955 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.835899 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 18:37:08.836108 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.836079 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 18:37:08.836108 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.836089 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9ktdg\"" Oct 30 18:37:08.836108 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.836088 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-zcgpq\"" Oct 30 18:37:08.836249 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.836146 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 18:37:08.836249 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:08.836181 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d48sc\"" Oct 30 18:37:09.117728 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:09.117640 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4mcxv" event={"ID":"5fe7ce49-5f2c-4057-b653-6f20a1eae46f","Type":"ContainerStarted","Data":"32ea5fe144e64d9aa8a52125fbf5399b84e1882f63a7569223f2a7ee64dc8d3f"} Oct 30 18:37:09.505228 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:09.505191 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:09.505419 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:09.505310 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:37:09.505419 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:09.505363 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls podName:f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:11.505350155 +0000 UTC m=+34.090050852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls") pod "dns-default-5xf4w" (UID: "f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e") : secret "dns-default-metrics-tls" not found Oct 30 18:37:11.519964 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:11.519918 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:11.520345 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:11.520077 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:37:11.520345 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:11.520145 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls podName:f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:15.520130158 +0000 UTC m=+38.104830855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls") pod "dns-default-5xf4w" (UID: "f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e") : secret "dns-default-metrics-tls" not found Oct 30 18:37:11.620804 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:11.620734 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:11.620804 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:11.620779 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:11.620997 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:11.620882 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:37:11.620997 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:11.620969 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:43.620953403 +0000 UTC m=+66.205654100 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : secret "metrics-daemon-secret" not found Oct 30 18:37:11.622989 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:11.622973 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:11.721362 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:11.721328 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:11.723758 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:11.723732 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:11.890668 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:11.890584 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:11.904869 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:11.904847 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:12.126432 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:12.126395 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4mcxv" event={"ID":"5fe7ce49-5f2c-4057-b653-6f20a1eae46f","Type":"ContainerStarted","Data":"8c8dd2bce320638a61137575013efc82e3ebae4c3d962db7d5c7b388e4c7ffb2"} Oct 30 18:37:12.173297 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:12.173254 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4mcxv" podStartSLOduration=2.50517533 podStartE2EDuration="5.173242752s" totalImagesPullingTime="2.668067422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:12.172790715 +0000 UTC m=+34.757491435" watchObservedRunningTime="2026-10-30 18:37:12.173242752 +0000 UTC m=+34.757943475" Oct 30 18:37:12.241268 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:12.241239 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rsknn"] Oct 30 18:37:12.244809 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:37:12.244784 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fcc356d_56b0_442e_a80e_6f9d4ad53362.slice/crio-efc6baa46f77353b00b6fcbdf506484e016cd393101bb9b7c863992d39b19e35 WatchSource:0}: Error finding container efc6baa46f77353b00b6fcbdf506484e016cd393101bb9b7c863992d39b19e35: Status 404 returned error can't find the container with id efc6baa46f77353b00b6fcbdf506484e016cd393101bb9b7c863992d39b19e35 Oct 30 18:37:12.253413 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:12.253389 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8cj4"] Oct 30 18:37:12.256718 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:37:12.256690 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74100cb_b82a_4e6b_a764_c2f090c71913.slice/crio-7b58e256b4428468affad91d6e70f6164bdfb327f6e68c1ec50b501023caabd8 WatchSource:0}: Error finding container 7b58e256b4428468affad91d6e70f6164bdfb327f6e68c1ec50b501023caabd8: Status 404 returned error can't find the container with id 7b58e256b4428468affad91d6e70f6164bdfb327f6e68c1ec50b501023caabd8 Oct 30 18:37:13.130686 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.130642 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8cj4" event={"ID":"a74100cb-b82a-4e6b-a764-c2f090c71913","Type":"ContainerStarted","Data":"7b58e256b4428468affad91d6e70f6164bdfb327f6e68c1ec50b501023caabd8"} Oct 30 18:37:13.132448 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.132412 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rsknn" event={"ID":"3fcc356d-56b0-442e-a80e-6f9d4ad53362","Type":"ContainerStarted","Data":"efc6baa46f77353b00b6fcbdf506484e016cd393101bb9b7c863992d39b19e35"} Oct 30 18:37:13.354548 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.354507 2544 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4"] Oct 30 18:37:13.377265 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.377228 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4"] Oct 30 18:37:13.377451 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.377429 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4" Oct 30 18:37:13.395211 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.395181 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 18:37:13.408747 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.408673 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gwgkn\"" Oct 30 18:37:13.408747 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.408704 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 18:37:13.532558 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.532525 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmsfn\" (UniqueName: \"kubernetes.io/projected/e45bb708-24ad-44a5-af48-80ddf8d6e984-kube-api-access-pmsfn\") pod \"migrator-66df5d496b-vpvn4\" (UID: \"e45bb708-24ad-44a5-af48-80ddf8d6e984\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4" Oct 30 18:37:13.634271 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.633865 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmsfn\" (UniqueName: \"kubernetes.io/projected/e45bb708-24ad-44a5-af48-80ddf8d6e984-kube-api-access-pmsfn\") pod \"migrator-66df5d496b-vpvn4\" (UID: \"e45bb708-24ad-44a5-af48-80ddf8d6e984\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4" Oct 30 18:37:13.661373 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.661301 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmsfn\" (UniqueName: \"kubernetes.io/projected/e45bb708-24ad-44a5-af48-80ddf8d6e984-kube-api-access-pmsfn\") pod \"migrator-66df5d496b-vpvn4\" (UID: \"e45bb708-24ad-44a5-af48-80ddf8d6e984\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4" Oct 30 18:37:13.702328 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.702298 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4" Oct 30 18:37:13.834292 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.834268 2544 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x64kx"] Oct 30 18:37:13.856594 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.856011 2544 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:13.857977 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.857956 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x64kx"] Oct 30 18:37:13.875934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.875489 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 18:37:13.875934 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.875600 2544 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5w9ll\"" Oct 30 18:37:13.956336 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.956306 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 18:37:13.956660 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.956503 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 18:37:13.956846 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:13.956791 2544 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 18:37:14.036812 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.036704 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.036812 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.036757 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/697b8251-3b4f-49ff-934e-f0242b39ac2a-crio-socket\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.036812 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.036786 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.037092 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.036898 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/697b8251-3b4f-49ff-934e-f0242b39ac2a-data-volume\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.037092 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.036990 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psxhw\" (UniqueName: \"kubernetes.io/projected/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-api-access-psxhw\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.045479 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.045452 2544 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4"] Oct 30 18:37:14.050313 ip-10-0-135-87 kubenswrapper[2544]: W1030 18:37:14.050284 2544 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45bb708_24ad_44a5_af48_80ddf8d6e984.slice/crio-9e3524d3248d1fc49a64eba22854c97f2f10506652aa7d060ef762f41a9b97e5 WatchSource:0}: Error finding container 9e3524d3248d1fc49a64eba22854c97f2f10506652aa7d060ef762f41a9b97e5: Status 404 returned error can't find the container with id 9e3524d3248d1fc49a64eba22854c97f2f10506652aa7d060ef762f41a9b97e5 Oct 30 18:37:14.137572 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.137537 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.137572 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.137577 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/697b8251-3b4f-49ff-934e-f0242b39ac2a-crio-socket\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.138114 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.137602 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.138114 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.137601 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4" event={"ID":"e45bb708-24ad-44a5-af48-80ddf8d6e984","Type":"ContainerStarted","Data":"9e3524d3248d1fc49a64eba22854c97f2f10506652aa7d060ef762f41a9b97e5"} Oct 30 18:37:14.138114 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.137629 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/697b8251-3b4f-49ff-934e-f0242b39ac2a-data-volume\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.138114 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.137658 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psxhw\" (UniqueName: \"kubernetes.io/projected/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-api-access-psxhw\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.138114 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:14.137707 2544 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:37:14.138114 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:14.137728 2544 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 18:37:14.138114 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:14.137768 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:14.637747792 +0000 UTC m=+37.222448510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : secret "insights-runtime-extractor-tls" not found Oct 30 18:37:14.138114 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:14.137797 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:14.637779669 +0000 UTC m=+37.222480382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : configmap "kube-rbac-proxy" not found Oct 30 18:37:14.138114 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.138008 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/697b8251-3b4f-49ff-934e-f0242b39ac2a-crio-socket\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.138384 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.138232 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/697b8251-3b4f-49ff-934e-f0242b39ac2a-data-volume\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.159998 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.159974 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psxhw\" (UniqueName: \"kubernetes.io/projected/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-api-access-psxhw\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.641089 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.641044 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.641279 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:14.641099 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:14.641279 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:14.641225 2544 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:37:14.641392 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:14.641297 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:15.641282035 +0000 UTC m=+38.225982736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : secret "insights-runtime-extractor-tls" not found Oct 30 18:37:14.641392 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:14.641299 2544 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 18:37:14.641392 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:14.641354 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:15.641337571 +0000 UTC m=+38.226038283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : configmap "kube-rbac-proxy" not found Oct 30 18:37:15.548451 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:15.548411 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:15.548940 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:15.548571 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:37:15.548940 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:15.548636 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls podName:f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:23.548618926 +0000 UTC m=+46.133319643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls") pod "dns-default-5xf4w" (UID: "f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e") : secret "dns-default-metrics-tls" not found Oct 30 18:37:15.649307 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:15.649283 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:15.649432 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:15.649324 2544 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:15.649495 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:15.649433 2544 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 18:37:15.649495 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:15.649452 2544 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:37:15.649587 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:15.649494 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:17.649476279 +0000 UTC m=+40.234176992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : configmap "kube-rbac-proxy" not found Oct 30 18:37:15.649587 ip-10-0-135-87 kubenswrapper[2544]: E1030 18:37:15.649513 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:17.649503788 +0000 UTC m=+40.234204501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : secret "insights-runtime-extractor-tls" not found Oct 30 18:37:16.145375 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:16.145298 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8cj4" event={"ID":"a74100cb-b82a-4e6b-a764-c2f090c71913","Type":"ContainerStarted","Data":"7f7501c40a5d7efde4bf1551750ea16ad954d4326f9a0c61ff934babfe5345c3"} Oct 30 18:37:16.145591 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:16.145440 2544 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:16.147045 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:16.147018 2544 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4" event={"ID":"e45bb708-24ad-44a5-af48-80ddf8d6e984","Type":"ContainerStarted","Data":"f34edca8bb0e2dbf98633005dc701eec366f822aed51654bcbdfea467bcf1c28"} Oct 30 18:37:16.190080 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:16.190020 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r8cj4" podStartSLOduration=34.553259586 podStartE2EDuration="38.190002259s" totalImagesPullingTime="3.636742673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:16.189185703 +0000 UTC m=+38.773886435" watchObservedRunningTime="2026-10-30 18:37:16.190002259 +0000 UTC m=+38.774702979" Oct 30 18:37:16.232107 ip-10-0-135-87 kubenswrapper[2544]: I1030 18:37:16.232062 2544 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4" podStartSLOduration=1.653148302 podStartE2EDuration="3.232049024s" totalImagesPullingTime="1.578900722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:16.231607414 +0000 UTC m=+38.816308134" watchObservedRunningTime="2026-10-30 18:37:16.232049024 +0000 UTC m=+38.816749742" Oct 30 18:37:17.568762 ip-10-0-135-87 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 18:37:17.580284 ip-10-0-135-87 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 18:37:17.580492 ip-10-0-135-87 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 18:37:17.580548 ip-10-0-135-87 systemd[1]: kubelet.service: Consumed 2.256s CPU time. Oct 30 18:37:17.592412 ip-10-0-135-87 systemd[1]: Starting Kubernetes Kubelet... Oct 30 18:37:17.689970 ip-10-0-135-87 kubenswrapper[4392]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:37:17.689970 ip-10-0-135-87 kubenswrapper[4392]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 18:37:17.689970 ip-10-0-135-87 kubenswrapper[4392]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:37:17.689970 ip-10-0-135-87 kubenswrapper[4392]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:37:17.692342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692255 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:37:17.692342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692337 4392 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:37:17.692342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692344 4392 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:37:17.692342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692348 4392 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692352 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692357 4392 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692361 4392 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692365 4392 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692369 4392 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692372 4392 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692377 4392 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692381 4392 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692385 4392 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692389 4392 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692401 4392 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692406 4392 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692409 4392 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692414 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692418 4392 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692422 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692426 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692430 4392 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692434 4392 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:37:17.692613 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692438 4392 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692442 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692446 4392 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692450 4392 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692454 4392 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692458 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692462 4392 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692466 4392 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692470 4392 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692476 4392 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692483 4392 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692488 4392 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692493 4392 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692499 4392 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692504 4392 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692508 4392 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692513 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692517 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692522 4392 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:37:17.693513 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692526 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692531 4392 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692535 4392 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692539 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692544 4392 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692549 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692554 4392 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692558 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692562 4392 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692567 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692571 4392 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692577 4392 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692582 4392 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692587 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692591 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692596 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692600 4392 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692605 4392 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692609 4392 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:37:17.694375 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692613 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692617 4392 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692622 4392 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692626 4392 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692630 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692634 4392 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692639 4392 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692651 4392 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692656 4392 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692660 4392 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692665 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692669 4392 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692674 4392 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692678 4392 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692682 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692686 4392 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692690 4392 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692694 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692699 4392 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692704 4392 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:37:17.695222 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692709 4392 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692714 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692719 4392 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692723 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692728 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692732 4392 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692736 4392 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692740 4392 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692747 4392 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692754 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692760 4392 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692765 4392 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692769 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692773 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692778 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692782 4392 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692786 4392 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692791 4392 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692795 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:37:17.696126 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692801 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692806 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692810 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692815 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692819 4392 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.692823 4392 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694131 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694143 4392 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694149 4392 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694154 4392 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694158 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694163 4392 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694168 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694173 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694177 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694182 4392 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694186 4392 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694190 4392 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694194 4392 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694198 4392 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:37:17.696989 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694203 4392 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694207 4392 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694212 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694217 4392 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694221 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694225 4392 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694229 4392 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694234 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694238 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694242 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694246 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694250 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694255 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694259 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694263 4392 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694267 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694272 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694276 4392 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694280 4392 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:37:17.697888 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694284 4392 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694288 4392 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694292 4392 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694297 4392 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694301 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694305 4392 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694310 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694318 4392 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694326 4392 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694331 4392 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694337 4392 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694342 4392 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694346 4392 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694350 4392 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694355 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694360 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694364 4392 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694369 4392 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694373 4392 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694377 4392 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:37:17.698717 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694381 4392 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694384 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694388 4392 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694392 4392 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694397 4392 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694401 4392 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694406 4392 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694410 4392 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694414 4392 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694419 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694423 4392 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694427 4392 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694432 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694436 4392 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694441 4392 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694445 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694449 4392 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694454 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694458 4392 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694464 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:37:17.699286 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694469 4392 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694473 4392 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694477 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694481 4392 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694486 4392 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694490 4392 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694494 4392 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694499 4392 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694503 4392 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694508 4392 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694512 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694517 4392 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694521 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694525 4392 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694529 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694533 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694538 4392 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694542 4392 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694547 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:37:17.699814 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694551 4392 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694555 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694559 4392 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694563 4392 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694567 4392 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694571 4392 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694575 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694580 4392 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694586 4392 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694591 4392 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694597 4392 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694601 4392 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694607 4392 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.694611 4392 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695422 4392 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695432 4392 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695436 4392 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695441 4392 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695445 4392 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695449 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:37:17.700315 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695454 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695459 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695463 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695467 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695472 4392 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695476 4392 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695480 4392 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695485 4392 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695489 4392 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695494 4392 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695498 4392 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695503 4392 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695508 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695512 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695517 4392 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695521 4392 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695525 4392 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695529 4392 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695534 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:37:17.700874 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695538 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695542 4392 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695546 4392 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695551 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695555 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695559 4392 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695564 4392 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695570 4392 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695576 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695580 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695584 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695588 4392 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695593 4392 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695601 4392 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695605 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695609 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695614 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695618 4392 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695622 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695626 4392 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:37:17.701363 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695631 4392 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695635 4392 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695643 4392 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695650 4392 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695654 4392 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695659 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695663 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695667 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695671 4392 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695675 4392 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695680 4392 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695684 4392 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695688 4392 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695692 4392 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695697 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695701 4392 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695705 4392 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695709 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695713 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:37:17.701862 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695717 4392 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695722 4392 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695727 4392 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695731 4392 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695735 4392 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695740 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695745 4392 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695750 4392 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695754 4392 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695758 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695762 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695766 4392 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695771 4392 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695775 4392 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695779 4392 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695784 4392 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695789 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695793 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695797 4392 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695801 4392 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:37:17.702504 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695806 4392 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695810 4392 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695814 4392 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695819 4392 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695823 4392 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695827 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695831 4392 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695835 4392 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695840 4392 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695844 4392 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695848 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695853 4392 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695857 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695861 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695866 4392 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695870 4392 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695874 4392 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695878 4392 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695886 4392 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695890 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:37:17.703342 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695895 4392 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.695899 4392 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696046 4392 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696063 4392 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696075 4392 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696082 4392 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696089 4392 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696094 4392 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696101 4392 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696108 4392 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696113 4392 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696118 4392 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696124 4392 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696129 4392 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696134 4392 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696139 4392 flags.go:64] FLAG: --cgroup-root="" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696143 4392 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696148 4392 flags.go:64] FLAG: --client-ca-file="" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696152 4392 flags.go:64] FLAG: --cloud-provider="external" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696157 4392 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696165 4392 flags.go:64] FLAG: --cluster-domain="" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696170 4392 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696175 4392 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696181 4392 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 18:37:17.703840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696186 4392 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696193 4392 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696198 4392 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696203 4392 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696209 4392 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696214 4392 flags.go:64] FLAG: --contention-profiling="false" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696222 4392 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696226 4392 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696232 4392 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696236 4392 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696243 4392 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696248 4392 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696255 4392 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696260 4392 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696265 4392 flags.go:64] FLAG: --enable-server="true" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696270 4392 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696277 4392 flags.go:64] FLAG: --event-burst="100" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696283 4392 flags.go:64] FLAG: --event-qps="50" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696287 4392 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696292 4392 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696297 4392 flags.go:64] FLAG: --eviction-hard="" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696304 4392 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696309 4392 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696314 4392 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696319 4392 flags.go:64] FLAG: --eviction-soft="" Oct 30 18:37:17.704459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696324 4392 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696329 4392 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696333 4392 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696338 4392 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696343 4392 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696348 4392 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696352 4392 flags.go:64] FLAG: --feature-gates="" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696359 4392 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696364 4392 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696369 4392 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696374 4392 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696404 4392 flags.go:64] FLAG: --healthz-port="10248" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696410 4392 flags.go:64] FLAG: --help="false" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696418 4392 flags.go:64] FLAG: --hostname-override="ip-10-0-135-87.ec2.internal" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696424 4392 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696429 4392 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696434 4392 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696439 4392 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696445 4392 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696451 4392 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696456 4392 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696461 4392 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696466 4392 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 18:37:17.705144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696471 4392 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696476 4392 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696480 4392 flags.go:64] FLAG: --kube-reserved="" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696485 4392 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696490 4392 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696495 4392 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696499 4392 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696504 4392 flags.go:64] FLAG: --lock-file="" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696508 4392 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696513 4392 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696518 4392 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696527 4392 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696532 4392 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696536 4392 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696541 4392 flags.go:64] FLAG: --logging-format="text" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696546 4392 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696552 4392 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696557 4392 flags.go:64] FLAG: --manifest-url="" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696561 4392 flags.go:64] FLAG: --manifest-url-header="" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696569 4392 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696574 4392 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696580 4392 flags.go:64] FLAG: --max-pods="110" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696588 4392 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696593 4392 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696598 4392 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 18:37:17.705839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696603 4392 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696608 4392 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696613 4392 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696620 4392 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696631 4392 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696636 4392 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696641 4392 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696653 4392 flags.go:64] FLAG: --pod-cidr="" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696658 4392 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696663 4392 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696668 4392 flags.go:64] FLAG: --pods-per-core="0" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696673 4392 flags.go:64] FLAG: --port="10250" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696678 4392 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696683 4392 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09758dfa71d853fa2" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696688 4392 flags.go:64] FLAG: --qos-reserved="" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696692 4392 flags.go:64] FLAG: --read-only-port="10255" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696698 4392 flags.go:64] FLAG: --register-node="true" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696702 4392 flags.go:64] FLAG: --register-with-taints="" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696709 4392 flags.go:64] FLAG: --registry-burst="10" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696713 4392 flags.go:64] FLAG: --registry-qps="5" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696718 4392 flags.go:64] FLAG: --reserved-cpus="" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696723 4392 flags.go:64] FLAG: --reserved-memory="" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696730 4392 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696735 4392 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696740 4392 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696745 4392 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 18:37:17.706454 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696749 4392 flags.go:64] FLAG: --runonce="false" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696754 4392 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696759 4392 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696768 4392 flags.go:64] FLAG: --seccomp-default="false" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696773 4392 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696778 4392 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696783 4392 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696788 4392 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696793 4392 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696800 4392 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696805 4392 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696809 4392 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696814 4392 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696819 4392 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696824 4392 flags.go:64] FLAG: --system-cgroups="" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696828 4392 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696837 4392 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696842 4392 flags.go:64] FLAG: --tls-cert-file="" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696846 4392 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696854 4392 flags.go:64] FLAG: --tls-min-version="" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696859 4392 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696863 4392 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696868 4392 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696873 4392 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696878 4392 flags.go:64] FLAG: --v="2" Oct 30 18:37:17.707121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696884 4392 flags.go:64] FLAG: --version="false" Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696891 4392 flags.go:64] FLAG: --vmodule="" Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696897 4392 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.696917 4392 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697142 4392 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697150 4392 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697156 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697161 4392 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697168 4392 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697175 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697181 4392 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697187 4392 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697192 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697198 4392 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697202 4392 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697206 4392 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697213 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697217 4392 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697222 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:37:17.708040 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697226 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697230 4392 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697234 4392 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697240 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697245 4392 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697249 4392 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697253 4392 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697257 4392 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697262 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697266 4392 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697270 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697275 4392 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697279 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697283 4392 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697287 4392 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697292 4392 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697296 4392 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697303 4392 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697308 4392 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697313 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:37:17.708831 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697318 4392 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697322 4392 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697327 4392 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697331 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697336 4392 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697341 4392 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697345 4392 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697350 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697354 4392 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697360 4392 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697365 4392 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697370 4392 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697374 4392 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697378 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697383 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697387 4392 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697391 4392 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697395 4392 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697399 4392 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:37:17.709478 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697404 4392 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697408 4392 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697413 4392 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697417 4392 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697422 4392 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697426 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697430 4392 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697434 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697439 4392 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697443 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697447 4392 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697452 4392 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697456 4392 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697460 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697465 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697470 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697473 4392 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697478 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697482 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697487 4392 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:37:17.710011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697491 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697495 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697502 4392 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697506 4392 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697510 4392 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697515 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697519 4392 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697523 4392 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697527 4392 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697531 4392 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697536 4392 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697540 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697544 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697549 4392 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697553 4392 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697558 4392 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697562 4392 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697566 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697571 4392 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697575 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:37:17.710600 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697579 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697584 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697588 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697593 4392 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697597 4392 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697602 4392 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697606 4392 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697611 4392 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697615 4392 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697619 4392 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697623 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697627 4392 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.697667 4392 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697727 4392 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697733 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697741 4392 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:37:17.711244 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697745 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697750 4392 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697754 4392 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697759 4392 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697765 4392 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697771 4392 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697777 4392 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697781 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697786 4392 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697790 4392 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697795 4392 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697799 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697803 4392 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697808 4392 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697812 4392 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697817 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697821 4392 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697826 4392 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697830 4392 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:37:17.711866 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697835 4392 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697839 4392 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697843 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697847 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697852 4392 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697856 4392 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697860 4392 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697865 4392 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697869 4392 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697873 4392 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697879 4392 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697883 4392 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697890 4392 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697894 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697898 4392 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697919 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697924 4392 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697930 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697934 4392 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:37:17.712700 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697938 4392 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697943 4392 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697948 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697951 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697957 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697962 4392 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697966 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697970 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697975 4392 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697979 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697984 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697988 4392 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697993 4392 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.697997 4392 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698001 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698006 4392 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698010 4392 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698015 4392 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698019 4392 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698023 4392 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:37:17.713655 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698028 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698032 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698036 4392 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698041 4392 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698046 4392 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698054 4392 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698058 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698063 4392 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698067 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698071 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698077 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698082 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698086 4392 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698090 4392 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698095 4392 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698099 4392 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698104 4392 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698108 4392 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698113 4392 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698117 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:37:17.714486 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698121 4392 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698126 4392 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698130 4392 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698134 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698139 4392 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698147 4392 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698152 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698157 4392 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698161 4392 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698166 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698170 4392 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698174 4392 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698178 4392 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698183 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698188 4392 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698192 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698196 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698203 4392 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698207 4392 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:37:17.715351 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698212 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698216 4392 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698220 4392 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698226 4392 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698231 4392 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.698235 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.702028 4392 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.702045 4392 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.702063 4392 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.702068 4392 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702274 4392 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702296 4392 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702302 4392 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702307 4392 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702319 4392 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702324 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702333 4392 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702341 4392 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702347 4392 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:37:17.716182 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702353 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702359 4392 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702365 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702370 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702375 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702380 4392 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702385 4392 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702395 4392 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702400 4392 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702406 4392 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702411 4392 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702416 4392 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702427 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702433 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702438 4392 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702443 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702448 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702453 4392 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702458 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702463 4392 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:37:17.717011 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702474 4392 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702479 4392 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702484 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702489 4392 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702495 4392 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702500 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702505 4392 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702510 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702518 4392 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702524 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702530 4392 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702534 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702544 4392 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702550 4392 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702555 4392 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702560 4392 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702565 4392 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702570 4392 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702575 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:37:17.717930 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702580 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702585 4392 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702590 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702595 4392 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702600 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702606 4392 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702616 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702622 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702628 4392 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702633 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702638 4392 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702642 4392 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702647 4392 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702652 4392 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702657 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702662 4392 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702667 4392 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702672 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702682 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:37:17.718782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702687 4392 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702691 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702697 4392 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702702 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702707 4392 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702712 4392 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702718 4392 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702723 4392 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702728 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702733 4392 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702738 4392 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702742 4392 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702752 4392 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702757 4392 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702762 4392 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702768 4392 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702774 4392 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702779 4392 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702784 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702789 4392 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:37:17.719666 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702795 4392 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702801 4392 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702806 4392 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702811 4392 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702816 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702825 4392 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702830 4392 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702835 4392 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702840 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702844 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702849 4392 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702854 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702859 4392 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702864 4392 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702869 4392 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702874 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702879 4392 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702889 4392 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:37:17.720621 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.702894 4392 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.702966 4392 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703560 4392 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703575 4392 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703578 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703581 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703585 4392 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703588 4392 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703591 4392 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703595 4392 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703597 4392 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703600 4392 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703603 4392 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703606 4392 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703609 4392 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703613 4392 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:37:17.721428 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703616 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703618 4392 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703621 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703624 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703627 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703629 4392 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703632 4392 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703634 4392 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703637 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703640 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703643 4392 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703646 4392 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703648 4392 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703651 4392 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703654 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703656 4392 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703659 4392 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703662 4392 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703666 4392 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:37:17.722227 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703672 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703675 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703678 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703682 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703684 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703688 4392 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703690 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703693 4392 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703696 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703700 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703703 4392 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703705 4392 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703708 4392 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703711 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703713 4392 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703716 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703719 4392 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703721 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703724 4392 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:37:17.722827 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703726 4392 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703729 4392 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703733 4392 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703736 4392 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703738 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703741 4392 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703743 4392 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703746 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703749 4392 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703751 4392 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703754 4392 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703757 4392 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703759 4392 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703762 4392 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703765 4392 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703767 4392 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703770 4392 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703772 4392 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703775 4392 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703778 4392 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:37:17.723590 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703780 4392 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703783 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703786 4392 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703789 4392 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703792 4392 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703795 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703815 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703820 4392 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703823 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703826 4392 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703829 4392 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703832 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703834 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703837 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703840 4392 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703843 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703846 4392 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703848 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703851 4392 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:37:17.724374 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703853 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703857 4392 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703859 4392 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703862 4392 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703864 4392 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703867 4392 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703870 4392 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703872 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703876 4392 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703880 4392 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703883 4392 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703885 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703888 4392 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703890 4392 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703893 4392 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.703939 4392 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:37:17.725028 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703975 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703980 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703983 4392 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703986 4392 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703989 4392 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703991 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703994 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703996 4392 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.703999 4392 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704001 4392 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704004 4392 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704007 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704009 4392 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704012 4392 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704015 4392 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704019 4392 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704022 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704025 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704028 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:37:17.725516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704030 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704036 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704038 4392 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704041 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704043 4392 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704046 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704048 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704051 4392 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704053 4392 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704056 4392 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704058 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704061 4392 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704063 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704066 4392 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704070 4392 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704073 4392 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704076 4392 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704079 4392 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704082 4392 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:37:17.726134 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704084 4392 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704087 4392 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704089 4392 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704092 4392 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704094 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704097 4392 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704099 4392 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704102 4392 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704105 4392 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704107 4392 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704110 4392 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704112 4392 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704115 4392 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704117 4392 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704121 4392 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704124 4392 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704126 4392 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704129 4392 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704132 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704135 4392 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:37:17.726598 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704138 4392 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704140 4392 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704143 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704145 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704148 4392 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704150 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704153 4392 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704158 4392 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704161 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704164 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704167 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704169 4392 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704172 4392 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704174 4392 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704177 4392 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704179 4392 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704182 4392 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704185 4392 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704187 4392 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:37:17.727093 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704190 4392 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704192 4392 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704195 4392 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704197 4392 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704200 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704204 4392 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704207 4392 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704212 4392 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704215 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704218 4392 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704220 4392 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704223 4392 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704226 4392 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704229 4392 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704231 4392 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704234 4392 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704237 4392 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704239 4392 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704242 4392 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704244 4392 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:37:17.727555 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704248 4392 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704251 4392 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704253 4392 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704256 4392 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704259 4392 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704262 4392 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704264 4392 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704267 4392 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:17.704269 4392 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.704329 4392 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.705299 4392 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.705356 4392 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.705532 4392 server.go:1014] "Starting client certificate rotation" Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.705675 4392 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.705732 4392 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 18:31:38 +0000 UTC" deadline="2028-05-26 15:52:12.184002377 +0000 UTC" Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.705760 4392 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13773h14m54.478244014s" Oct 30 18:37:17.728129 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.705995 4392 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 18:37:17.728660 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.707078 4392 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 18:37:17.728660 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.708723 4392 log.go:25] "Validated CRI v1 runtime API" Oct 30 18:37:17.728660 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.710402 4392 log.go:25] "Validated CRI v1 image API" Oct 30 18:37:17.728660 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.711182 4392 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 18:37:17.728660 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.713241 4392 fs.go:135] Filesystem UUIDs: map[29800dd5-3e7a-4370-a397-b029dce5f7dd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 81736c32-7a31-4222-8333-4f5a3acb2074:/dev/nvme0n1p4] Oct 30 18:37:17.728807 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.713261 4392 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2a5b2f327225da8f4f4fdb7e8f8db4ae8ee1b702ed8be9524063cc5f31a0fa19/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2a5b2f327225da8f4f4fdb7e8f8db4ae8ee1b702ed8be9524063cc5f31a0fa19/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/32ea5fe144e64d9aa8a52125fbf5399b84e1882f63a7569223f2a7ee64dc8d3f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/32ea5fe144e64d9aa8a52125fbf5399b84e1882f63a7569223f2a7ee64dc8d3f/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/610d4422a75555b64d03323693c04b6dbfd7478fce6c90f24fe35288f3558c4b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/610d4422a75555b64d03323693c04b6dbfd7478fce6c90f24fe35288f3558c4b/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6e66ee694c5994ea53aafe0c1e533a8a44d24412031115abf96d78b293e64d96/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6e66ee694c5994ea53aafe0c1e533a8a44d24412031115abf96d78b293e64d96/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75db4be93b5a4c982817bab69acff25aef4b27342e73e62028581aad8b0520a5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75db4be93b5a4c982817bab69acff25aef4b27342e73e62028581aad8b0520a5/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7b58e256b4428468affad91d6e70f6164bdfb327f6e68c1ec50b501023caabd8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7b58e256b4428468affad91d6e70f6164bdfb327f6e68c1ec50b501023caabd8/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8805a204224312afc8ddd67e833de3ee909190d75b71a2c3a5ccdf2ab7f08870/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8805a204224312afc8ddd67e833de3ee909190d75b71a2c3a5ccdf2ab7f08870/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9e3524d3248d1fc49a64eba22854c97f2f10506652aa7d060ef762f41a9b97e5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9e3524d3248d1fc49a64eba22854c97f2f10506652aa7d060ef762f41a9b97e5/userdata/shm major:0 minor:223 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b78dedc6a3adba0ed3c7ef78f1a1b33ce34f538db385d6f158b619b618b63077/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b78dedc6a3adba0ed3c7ef78f1a1b33ce34f538db385d6f158b619b618b63077/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/be2db8ca846cac53ab74c5a5471a0577da1c7bb52cd9c1eabe1aa8eab2006e65/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/be2db8ca846cac53ab74c5a5471a0577da1c7bb52cd9c1eabe1aa8eab2006e65/userdata/shm major:0 minor:87 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cb7727a15c10a80eece2ba1c3d5080d0f32711e520e5304b82300d3ac0248f60/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cb7727a15c10a80eece2ba1c3d5080d0f32711e520e5304b82300d3ac0248f60/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e42b60cfb5b92f48e4818926d5a4a4eff2a3ab4f777fdb645983adcdc56024ae/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e42b60cfb5b92f48e4818926d5a4a4eff2a3ab4f777fdb645983adcdc56024ae/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ee4718b131dc859a27be32a337818f475ba4de9f2022aec44f1add83b45b1d60/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ee4718b131dc859a27be32a337818f475ba4de9f2022aec44f1add83b45b1d60/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/efc6baa46f77353b00b6fcbdf506484e016cd393101bb9b7c863992d39b19e35/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/efc6baa46f77353b00b6fcbdf506484e016cd393101bb9b7c863992d39b19e35/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/010093ae-c8f4-40f7-82eb-935febcb2c0b/volumes/kubernetes.io~projected/kube-api-access-cvx46:{mountpoint:/var/lib/kubelet/pods/010093ae-c8f4-40f7-82eb-935febcb2c0b/volumes/kubernetes.io~projected/kube-api-access-cvx46 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0826e146-9efa-405a-a894-32fd660477de/volumes/kubernetes.io~projected/kube-api-access-dz9bj:{mountpoint:/var/lib/kubelet/pods/0826e146-9efa-405a-a894-32fd660477de/volumes/kubernetes.io~projected/kube-api-access-dz9bj major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/252ce72d-90ff-43a0-a76c-6e68ab140aac/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/252ce72d-90ff-43a0-a76c-6e68ab140aac/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/252ce72d-90ff-43a0-a76c-6e68ab140aac/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/252ce72d-90ff-43a0-a76c-6e68ab140aac/volumes/kubernetes.io~empty-dir/tmp major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/252ce72d-90ff-43a0-a76c-6e68ab140aac/volumes/kubernetes.io~projected/kube-api-access-dfm84:{mountpoint:/var/lib/kubelet/pods/252ce72d-90ff-43a0-a76c-6e68ab140aac/volumes/kubernetes.io~projected/kube-api-access-dfm84 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3fcc356d-56b0-442e-a80e-6f9d4ad53362/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/3fcc356d-56b0-442e-a80e-6f9d4ad53362/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/47fb71ba-fd5c-4279-8687-7954945eb63c/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/47fb71ba-fd5c-4279-8687-7954945eb63c/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/47fb71ba-fd5c-4279-8687-7954945eb63c/volumes/kubernetes.io~projected/kube-api-access-c76zg:{mountpoint:/var/lib/kubelet/pods/47fb71ba-fd5c-4279-8687-7954945eb63c/volumes/kubernetes.io~projected/kube-api-access-c76zg major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/47fb71ba-fd5c-4279-8687-7954945eb63c/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/47fb71ba-fd5c-4279-8687-7954945eb63c/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5fe7ce49-5f2c-4057-b653-6f20a1eae46f/volumes/kubernetes.io~projected/kube-api-access-rnlvv:{mountpoint:/var/lib/kubelet/pods/5fe7ce49-5f2c-4057-b653-6f20a1eae46f/volumes/kubernetes.io~projected/kube-api-access-rnlvv major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5fe7ce49-5f2c-4057-b653-6f20a1eae46f/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/5fe7ce49-5f2c-4057-b653-6f20a1eae46f/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/697b8251-3b4f-49ff-934e-f0242b39ac2a/volumes/kubernetes.io~projected/kube-api-access-psxhw:{mountpoint:/var/lib/kubelet/pods/697b8251-3b4f-49ff-934e-f0242b39ac2a/volumes/kubernetes.io~projected/kube-api-access-psxhw major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a3669583-9579-4c19-a246-8631b75c07f1/volumes/kubernetes.io~projected/kube-api-access-shclp:{mountpoint:/var/lib/kubelet/pods/a3669583-9579-4c19-a246-8631b75c07f1/volumes/kubernetes.io~projected/kube-api-access-shclp major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0/volumes/kubernetes.io~projected/kube-api-access-w4zhg:{mountpoint:/var/lib/kubelet/pods/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0/volumes/kubernetes.io~projected/kube-api-access-w4zhg major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a74100cb-b82a-4e6b-a764-c2f090c71913/volumes/kubernetes.io~projected/kube-api-access-m9g9j:{mountpoint:/var/lib/kubelet/pods/a74100cb-b82a-4e6b-a764-c2f090c71913/volumes/kubernetes.io~projected/kube-api-access-m9g9j major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b/volumes/kubernetes.io~projected/kube-api-access-pr5ln:{mountpoint:/var/lib/kubelet/pods/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b/volumes/kubernetes.io~projected/kube-api-access-pr5ln major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d363b0f3-9797-404d-bbf7-f5860726934e/volumes/kubernetes.io~projected/kube-api-access-rpbg9:{mountpoint:/var/lib/kubelet/pods/d363b0f3-9797-404d-bbf7-f5860726934e/volumes/kubernetes.io~projected/kube-api-access-rpbg9 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e116b674-1f7e-448b-a3c4-08dd88c96ef4/volumes/kubernetes.io~projected/kube-api-access-7wcbx:{mountpoint:/var/lib/kubelet/pods/e116b674-1f7e-448b-a3c4-08dd88c96ef4/volumes/kubernetes.io~projected/kube-api-access-7wcbx major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e45bb708-24ad-44a5-af48-80ddf8d6e984/volumes/kubernetes.io~projected/kube-api-access-pmsfn:{mountpoint:/var/lib/kubelet/pods/e45bb708-24ad-44a5-af48-80ddf8d6e984/volumes/kubernetes.io~projected/kube-api-access-pmsfn major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e/volumes/kubernetes.io~projected/kube-api-access-hc45g:{mountpoint:/var/lib/kubelet/pods/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e/volumes/kubernetes.io~projected/kube-api-access-hc45g major:0 minor:201 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/7a319c66842007496d99118086b90dcf4a5f17fa15d729f1cd2e80a2f1a66317/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/067a559ba7aacb99cc9dd084ed88dcc3a4c6ad5962ed8e634aadf36c45f7021d/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/79bd0f2af2b9e071204869dc9b84fbd44575cce6ed89ef1968d383a1db89d3e4/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/4354e73ddf4ae17747cfd2f0b1504e3a1272aad5cc8f4de7fd22ccfe940c20e7/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/5a929896ebfb42c44d574ae1c009bf9df0729c9b1a857f77f0937ae18b4649a4/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/b788f4aa0381e83f50c8eea5580a800df096f538907c4555019a7c8f3688b296/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/df9a0f7bdaf8d6c0d3c72ebed968dcccc6a7fc946daa2fbde060efd5d45898e2/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/c0ef0d62d02ef9ab657ad287838ec206f2157b27d4897868da1a1725233e31ef/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/4c53af585a3b492e8882f1eb7a4f4eb7495f32a42c33187899735a41c4adcc3f/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/5531d9c3229e7ac9073c804b9f131ca5cee776d283e2a8a0c1ef51bbe2bc3140/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/68072de1a4813830dcf54615642c4b7a794b8959e40d83cb035982b9a68ab782/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/b6a0a9164089f504b2041df346b73218038245366a6844bfb4e66a5c8044a396/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/f4d13897d39e5007100666d54ba2cea3519a0e5989a6db9342f9e9188402fb70/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/ee5c9a5eaf60884c51cce541449fe18c0dd5f1189ea9c70ee64e7e0a14ea9188/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/e27689283d75ffee32c7c037aead802149ef5b0cec72af345301aceba0ea7848/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/5224a55a30e8ae7e3265742cf4adc49212a3c6622bb6bb7b9266980959c1f568/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/c3a2e6c6389ab409f3ee4ee9b2c7dd9fbcb584fc15a2551ad4d2453005f8da00/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/5ef825417e429b5235776d47f5c81e94faa16cfc6c4145771fc88174b42233e1/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/bcf99b567ebf1d1ee04864de5d8e82e28214b7d6896baf5c736c88d2293c3de6/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/b7a289fb68389ee61268af41ced4be0b921e7031bfffe67686ec48242b5e7c44/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/5647fc518fe249799aadfbbf4882cc77b20f57fa5fefa0ef292d692fb3335181/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/2fc47ecc107e4cd9e237b24619140f2a40d282d818c7be2e885060d9a7a4390d/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-206:{mountpoint:/var/lib/containers/storage/overlay/b62be0be375fd808b4e58d23c6a8ccf0e7ccedc1ac057d3b299e86029f00897e/merged major:0 minor:206 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/2e94080dedde1f7acb3b3934b28f39d3f51d645b295330ada619fa449871eeac/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/ab6be749eeb2381f3fa34d449864ea4de970355f4e6e854f841213a276d0436f/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/bd8f9a748d218ebe09145b17ab446f110379ef7c992fea0a3ba92ab852c4ee32/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/4c09ebdd0347e39ad30bcef93ee21bb0df309d001f36ee3d9ad272870b78fea3/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/6cb59905493c93ef4041c9cc262475aa8f9ed01aee8659cecd3125f4dcd213f1/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/528700212a6ca14b77e17707c48b78ce7882cdcf4fcd96bcbb74e3a6e05d94d4/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/ed9e459b4c7090638c4b78234227a7ddf5338a5c281195b4ac54f2b3d23d0c81/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/bb6e6da60b1090a7d1b5402e53cf263ad8b5416f31ef8efd68db617fd4f4d618/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/4ec34a115e7b59dcb5684293203b6cd7bbd9881eab994392233f68579c6fa919/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/b440e8ccd4c27a147820e4421daf9246278fbd0044af8267c5a5058dceecd679/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/295078b82049afafa7a628925c293a3ba1d21749888beac68b6bef3d2ac2901c/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/b1521436ac8addfc1d90693d24665e4a6d2f4fb28716c495c14e34c320c49192/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/18888e15ab3064135cef5891e7c97fd621e1110b13dfacd79a96f1928bd424df/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/eab1558f96d9757358e478b77ea6bd01c6a680d1e7cbed1ff600fd9dd830296c/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/6f629e37214d1e87ea83ff6adc832e87f17bd42d8beb65860fa9a50b97b2323c/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/aaa176aa8daba0e3fa68978eb287733a26c5f29fe0c4f6b8a548eb88cf341e75/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.721798 4392 manager.go:217] Machine: {Timestamp:2026-10-30 18:37:17.72100675 +0000 UTC m=+0.084020108 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097819 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b43cae54d6d5b8d9d5dc2526cb2b1 SystemUUID:ec2b43ca-e54d-6d5b-8d9d-5dc2526cb2b1 BootID:ff52c89f-7b4b-46ca-b0a0-fe869c29f284 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8805a204224312afc8ddd67e833de3ee909190d75b71a2c3a5ccdf2ab7f08870/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/32ea5fe144e64d9aa8a52125fbf5399b84e1882f63a7569223f2a7ee64dc8d3f/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/697b8251-3b4f-49ff-934e-f0242b39ac2a/volumes/kubernetes.io~projected/kube-api-access-psxhw DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/010093ae-c8f4-40f7-82eb-935febcb2c0b/volumes/kubernetes.io~projected/kube-api-access-cvx46 DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/47fb71ba-fd5c-4279-8687-7954945eb63c/volumes/kubernetes.io~projected/kube-api-access-c76zg DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3fcc356d-56b0-442e-a80e-6f9d4ad53362/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/efc6baa46f77353b00b6fcbdf506484e016cd393101bb9b7c863992d39b19e35/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/252ce72d-90ff-43a0-a76c-6e68ab140aac/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/252ce72d-90ff-43a0-a76c-6e68ab140aac/volumes/kubernetes.io~projected/kube-api-access-dfm84 DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2a5b2f327225da8f4f4fdb7e8f8db4ae8ee1b702ed8be9524063cc5f31a0fa19/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/47fb71ba-fd5c-4279-8687-7954945eb63c/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5fe7ce49-5f2c-4057-b653-6f20a1eae46f/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5fe7ce49-5f2c-4057-b653-6f20a1eae46f/volumes/kubernetes.io~projected/kube-api-access-rnlvv DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e/volumes/kubernetes.io~projected/kube-api-access-hc45g DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e45bb708-24ad-44a5-af48-80ddf8d6e984/volumes/kubernetes.io~projected/kube-api-access-pmsfn DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/252ce72d-90ff-43a0-a76c-6e68ab140aac/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75db4be93b5a4c982817bab69acff25aef4b27342e73e62028581aad8b0520a5/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a74100cb-b82a-4e6b-a764-c2f090c71913/volumes/kubernetes.io~projected/kube-api-access-m9g9j DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/d363b0f3-9797-404d-bbf7-f5860726934e/volumes/kubernetes.io~projected/kube-api-access-rpbg9 DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0826e146-9efa-405a-a894-32fd660477de/volumes/kubernetes.io~projected/kube-api-access-dz9bj DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/e116b674-1f7e-448b-a3c4-08dd88c96ef4/volumes/kubernetes.io~projected/kube-api-access-7wcbx DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9e3524d3248d1fc49a64eba22854c97f2f10506652aa7d060ef762f41a9b97e5/userdata/shm DeviceMajor:0 DeviceMinor:223 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b78dedc6a3adba0ed3c7ef78f1a1b33ce34f538db385d6f158b619b618b63077/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0/volumes/kubernetes.io~projected/kube-api-access-w4zhg DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e42b60cfb5b92f48e4818926d5a4a4eff2a3ab4f777fdb645983adcdc56024ae/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/be2db8ca846cac53ab74c5a5471a0577da1c7bb52cd9c1eabe1aa8eab2006e65/userdata/shm DeviceMajor:0 DeviceMinor:87 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/610d4422a75555b64d03323693c04b6dbfd7478fce6c90f24fe35288f3558c4b/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-206 DeviceMajor:0 DeviceMinor:206 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6e66ee694c5994ea53aafe0c1e533a8a44d24412031115abf96d78b293e64d96/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7b58e256b4428468affad91d6e70f6164bdfb327f6e68c1ec50b501023caabd8/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b/volumes/kubernetes.io~projected/kube-api-access-pr5ln DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cb7727a15c10a80eece2ba1c3d5080d0f32711e520e5304b82300d3ac0248f60/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/47fb71ba-fd5c-4279-8687-7954945eb63c/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ee4718b131dc859a27be32a337818f475ba4de9f2022aec44f1add83b45b1d60/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a3669583-9579-4c19-a246-8631b75c07f1/volumes/kubernetes.io~projected/kube-api-access-shclp DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:32ea5fe144e64d9 MacAddress:6e:d0:91:11:15:81 Speed:10000 Mtu:8901} {Name:7b58e256b442846 MacAddress:1a:1e:70:ae:b9:9d Speed:10000 Mtu:8901} {Name:9e3524d3248d1fc MacAddress:aa:aa:f6:c2:d3:0d Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:f4:f6:0e:dd Speed:0 Mtu:9001} {Name:br-int MacAddress:86:2a:2a:88:19:4b Speed:0 Mtu:8901} {Name:efc6baa46f77353 MacAddress:c6:0a:95:32:ad:a8 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:f4:f6:0e:dd Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:5a:e1:2c:31:73:49 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:4e:6e:25:90:e8:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.722265 4392 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.722325 4392 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.722618 4392 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.722644 4392 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723127 4392 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723141 4392 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723157 4392 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723178 4392 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723283 4392 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723556 4392 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723710 4392 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723752 4392 kubelet.go:493] "Attempting to sync node with API server" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723771 4392 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723787 4392 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723807 4392 kubelet.go:405] "Adding apiserver pod source" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.723820 4392 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.725366 4392 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.725381 4392 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.725814 4392 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.727674 4392 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.727684 4392 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.727772 4392 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.727961 4392 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.727988 4392 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728076 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728089 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728095 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728100 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728106 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728112 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728118 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728123 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728130 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728137 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728145 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728155 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728177 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 18:37:17.728958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.728183 4392 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 18:37:17.731376 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.731362 4392 server.go:1263] "Started kubelet" Oct 30 18:37:17.731507 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.731456 4392 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 18:37:17.731551 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.731535 4392 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 18:37:17.731751 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.731427 4392 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 18:37:17.731919 ip-10-0-135-87 systemd[1]: Started Kubernetes Kubelet. Oct 30 18:37:17.733472 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.733456 4392 server.go:317] "Adding debug handlers to kubelet server" Oct 30 18:37:17.746863 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.746230 4392 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 18:37:17.746863 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.746257 4392 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 18:37:17.746863 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.746369 4392 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:31:40 +0000 UTC" deadline="2028-03-26 10:15:08.091821476 +0000 UTC" Oct 30 18:37:17.746863 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.746387 4392 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12303h37m50.345436756s" Oct 30 18:37:17.746863 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.746433 4392 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 18:37:17.746863 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.746447 4392 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 18:37:17.746863 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.746542 4392 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 18:37:17.746863 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:17.746586 4392 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-87.ec2.internal\" not found" Oct 30 18:37:17.746863 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.746725 4392 factory.go:55] Registering systemd factory Oct 30 18:37:17.746863 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.746739 4392 factory.go:223] Registration of the systemd container factory successfully Oct 30 18:37:17.748692 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748642 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="010093ae-c8f4-40f7-82eb-935febcb2c0b" volumeName="kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-daemon-config" seLinuxMountContext="" Oct 30 18:37:17.748779 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748693 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fe7ce49-5f2c-4057-b653-6f20a1eae46f" volumeName="kubernetes.io/projected/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-kube-api-access-rnlvv" seLinuxMountContext="" Oct 30 18:37:17.748779 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748706 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d363b0f3-9797-404d-bbf7-f5860726934e" volumeName="kubernetes.io/projected/d363b0f3-9797-404d-bbf7-f5860726934e-kube-api-access-rpbg9" seLinuxMountContext="" Oct 30 18:37:17.748779 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748718 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="010093ae-c8f4-40f7-82eb-935febcb2c0b" volumeName="kubernetes.io/projected/010093ae-c8f4-40f7-82eb-935febcb2c0b-kube-api-access-cvx46" seLinuxMountContext="" Oct 30 18:37:17.748779 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748728 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252ce72d-90ff-43a0-a76c-6e68ab140aac" volumeName="kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-tmp" seLinuxMountContext="" Oct 30 18:37:17.748779 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748739 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3fcc356d-56b0-442e-a80e-6f9d4ad53362" volumeName="kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret" seLinuxMountContext="" Oct 30 18:37:17.748779 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748750 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0" volumeName="kubernetes.io/empty-dir/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-tmp-dir" seLinuxMountContext="" Oct 30 18:37:17.748779 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748760 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e116b674-1f7e-448b-a3c4-08dd88c96ef4" volumeName="kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 18:37:17.748779 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748772 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e116b674-1f7e-448b-a3c4-08dd88c96ef4" volumeName="kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748783 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252ce72d-90ff-43a0-a76c-6e68ab140aac" volumeName="kubernetes.io/projected/252ce72d-90ff-43a0-a76c-6e68ab140aac-kube-api-access-dfm84" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748793 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="47fb71ba-fd5c-4279-8687-7954945eb63c" volumeName="kubernetes.io/secret/47fb71ba-fd5c-4279-8687-7954945eb63c-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748803 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3669583-9579-4c19-a246-8631b75c07f1" volumeName="kubernetes.io/configmap/a3669583-9579-4c19-a246-8631b75c07f1-serviceca" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748813 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0" volumeName="kubernetes.io/projected/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-kube-api-access-w4zhg" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748822 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e" volumeName="kubernetes.io/secret/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-agent-certs" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748835 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e116b674-1f7e-448b-a3c4-08dd88c96ef4" volumeName="kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-binary-copy" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748850 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e45bb708-24ad-44a5-af48-80ddf8d6e984" volumeName="kubernetes.io/projected/e45bb708-24ad-44a5-af48-80ddf8d6e984-kube-api-access-pmsfn" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748861 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="010093ae-c8f4-40f7-82eb-935febcb2c0b" volumeName="kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-cni-binary-copy" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748872 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fe7ce49-5f2c-4057-b653-6f20a1eae46f" volumeName="kubernetes.io/secret/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-cert" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748883 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="697b8251-3b4f-49ff-934e-f0242b39ac2a" volumeName="kubernetes.io/projected/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-api-access-psxhw" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748894 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e" volumeName="kubernetes.io/projected/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-kube-api-access-hc45g" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748921 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="47fb71ba-fd5c-4279-8687-7954945eb63c" volumeName="kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-script-lib" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748933 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="47fb71ba-fd5c-4279-8687-7954945eb63c" volumeName="kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-config" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748943 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="47fb71ba-fd5c-4279-8687-7954945eb63c" volumeName="kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-env-overrides" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748954 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a74100cb-b82a-4e6b-a764-c2f090c71913" volumeName="kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748965 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e" volumeName="kubernetes.io/configmap/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-config-volume" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748976 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3669583-9579-4c19-a246-8631b75c07f1" volumeName="kubernetes.io/projected/a3669583-9579-4c19-a246-8631b75c07f1-kube-api-access-shclp" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748988 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e116b674-1f7e-448b-a3c4-08dd88c96ef4" volumeName="kubernetes.io/projected/e116b674-1f7e-448b-a3c4-08dd88c96ef4-kube-api-access-7wcbx" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.748998 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="697b8251-3b4f-49ff-934e-f0242b39ac2a" volumeName="kubernetes.io/empty-dir/697b8251-3b4f-49ff-934e-f0242b39ac2a-data-volume" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.749013 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba11b962-ce4c-4b4a-9b1f-19ac22a0613b" volumeName="kubernetes.io/projected/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-kube-api-access-pr5ln" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.749023 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e" volumeName="kubernetes.io/configmap/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-konnectivity-ca" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.749034 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0826e146-9efa-405a-a894-32fd660477de" volumeName="kubernetes.io/projected/0826e146-9efa-405a-a894-32fd660477de-kube-api-access-dz9bj" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.749047 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252ce72d-90ff-43a0-a76c-6e68ab140aac" volumeName="kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-tuned" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.749059 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="47fb71ba-fd5c-4279-8687-7954945eb63c" volumeName="kubernetes.io/projected/47fb71ba-fd5c-4279-8687-7954945eb63c-kube-api-access-c76zg" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.749069 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba11b962-ce4c-4b4a-9b1f-19ac22a0613b" volumeName="kubernetes.io/configmap/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-iptables-alerter-script" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.749080 4392 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e" volumeName="kubernetes.io/empty-dir/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-tmp-dir" seLinuxMountContext="" Oct 30 18:37:17.749079 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.749091 4392 reconstruct.go:97] "Volume reconstruction finished" Oct 30 18:37:17.749862 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.749098 4392 reconciler.go:29] "Reconciler: start to sync state" Oct 30 18:37:17.750020 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.749998 4392 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 18:37:17.750161 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.750086 4392 factory.go:153] Registering CRI-O factory Oct 30 18:37:17.750161 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.750103 4392 factory.go:223] Registration of the crio container factory successfully Oct 30 18:37:17.750161 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.750151 4392 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 18:37:17.750161 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.750169 4392 factory.go:103] Registering Raw factory Oct 30 18:37:17.750404 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.750186 4392 manager.go:1199] Started watching for new ooms in manager Oct 30 18:37:17.750526 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.750513 4392 manager.go:319] Starting recovery of all containers Oct 30 18:37:17.778532 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.778492 4392 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 18:37:17.779993 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.779964 4392 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 18:37:17.779993 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.779996 4392 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 18:37:17.780150 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.780020 4392 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 18:37:17.780150 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:17.780062 4392 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 18:37:17.785501 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.785475 4392 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:37:17.787601 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.787144 4392 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:37:17.787601 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.787343 4392 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 18:37:17.800344 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.800321 4392 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:37:17.800709 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.800690 4392 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:37:17.804613 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.804584 4392 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="718468a4bb70edb445ac001f00448b2064e9c24c983c1db58c01f785b0d2b508" exitCode=0 Oct 30 18:37:17.804693 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.804613 4392 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="9105c6b4cbf9229e0daab09ebd2ef35b3c46b462e03d3e9603c083e0105b7a90" exitCode=0 Oct 30 18:37:17.804693 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.804626 4392 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="1c8acaa03cf5e3be9f19a3292d0853b0165f949ad12df3d8ec6084d741ff9ccc" exitCode=0 Oct 30 18:37:17.804693 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.804639 4392 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="2961c877658640bbe119d028929ec29b28a699d9aa997396040c4aa21c4ddc0d" exitCode=0 Oct 30 18:37:17.804693 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.804656 4392 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="78ca8419ee29a7a949ea61bd54e2eda4d53270522c11518a088c24eb2211de14" exitCode=0 Oct 30 18:37:17.804693 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.804665 4392 generic.go:356] "Generic (PLEG): container finished" podID="e116b674-1f7e-448b-a3c4-08dd88c96ef4" containerID="aa3b56130e045d617bf926ac6acbdc377fef69ec4677baf3c3e99b691fc52e49" exitCode=0 Oct 30 18:37:17.809614 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.809584 4392 generic.go:356] "Generic (PLEG): container finished" podID="c8836c14af0409d863d60cb41effd982" containerID="241087f575aa4759a0e5773542351931597bc51f3c157d5621068047a5c99be0" exitCode=0 Oct 30 18:37:17.812965 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.812949 4392 manager.go:324] Recovery completed Oct 30 18:37:17.827541 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827491 4392 cpu_manager.go:226] "Starting" policy="none" Oct 30 18:37:17.827541 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827505 4392 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 18:37:17.827541 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827520 4392 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 18:37:17.827688 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827624 4392 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 18:37:17.827688 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827635 4392 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 18:37:17.827688 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827651 4392 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 18:37:17.827688 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827656 4392 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 18:37:17.827688 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827661 4392 policy_none.go:50] "Start" Oct 30 18:37:17.827688 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827673 4392 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 18:37:17.827688 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827682 4392 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 18:37:17.827864 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827798 4392 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 18:37:17.827864 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827805 4392 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 18:37:17.827864 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.827810 4392 policy_none.go:44] "Start" Oct 30 18:37:17.831726 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.831702 4392 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 18:37:17.835220 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.835205 4392 manager.go:341] "Starting Device Plugin manager" Oct 30 18:37:17.835770 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:17.835230 4392 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 18:37:17.835770 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.835771 4392 server.go:87] "Starting device plugin registration server" Oct 30 18:37:17.836035 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.836016 4392 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 18:37:17.836122 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.836031 4392 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 18:37:17.836187 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.836134 4392 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 18:37:17.836238 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.836208 4392 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 18:37:17.836238 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.836236 4392 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 18:37:17.836308 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.836240 4392 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 18:37:17.836340 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.836290 4392 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T18:37:17.836227343Z","UUID":"c1ebd382-cc93-4897-b547-c50db60698e0","Handler":null,"Name":"","Endpoint":""} Oct 30 18:37:17.837836 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:17.837817 4392 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 18:37:17.838249 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.838229 4392 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 18:37:17.838347 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.838258 4392 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 18:37:17.880242 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.880204 4392 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal"] Oct 30 18:37:17.880634 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.880607 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" event={"ID":"ac0cf868632d3632743a3feebbcd95ab","Type":"ContainerStarted","Data":"63ee6ab62b9632255cd2735a7be9c60d271ea77f2e270ac6699427f82a7f32e3"} Oct 30 18:37:17.880684 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.880639 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" event={"ID":"ac0cf868632d3632743a3feebbcd95ab","Type":"ContainerStarted","Data":"ee4718b131dc859a27be32a337818f475ba4de9f2022aec44f1add83b45b1d60"} Oct 30 18:37:17.880738 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.880687 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" event={"ID":"c8836c14af0409d863d60cb41effd982","Type":"ContainerStarted","Data":"8ad3b0b7d44eb2bbdb22d691d8de29af6c8024af0dd5d8914d61603cf6ff1f83"} Oct 30 18:37:17.880738 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.880702 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" event={"ID":"c8836c14af0409d863d60cb41effd982","Type":"ContainerDied","Data":"241087f575aa4759a0e5773542351931597bc51f3c157d5621068047a5c99be0"} Oct 30 18:37:17.880738 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.880710 4392 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:37:17.880887 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.880713 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" event={"ID":"c8836c14af0409d863d60cb41effd982","Type":"ContainerStarted","Data":"6e66ee694c5994ea53aafe0c1e533a8a44d24412031115abf96d78b293e64d96"} Oct 30 18:37:17.880970 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.880942 4392 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:37:17.903858 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.903829 4392 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 18:37:17.903950 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:17.903885 4392 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-87.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:37:17.904441 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.904428 4392 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 18:37:17.904485 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:17.904460 4392 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:37:17.936561 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.936544 4392 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:37:17.937861 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.937843 4392 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:37:17.937974 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.937872 4392 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:37:17.937974 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.937889 4392 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-87.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:37:17.937974 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.937939 4392 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-87.ec2.internal" Oct 30 18:37:17.972931 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.972895 4392 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-87.ec2.internal" Oct 30 18:37:17.973014 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.972968 4392 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-87.ec2.internal" Oct 30 18:37:17.988665 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.988634 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:37:17.988751 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.988691 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:37:17.988751 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:17.988735 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac0cf868632d3632743a3feebbcd95ab-config\") pod \"kube-apiserver-proxy-ip-10-0-135-87.ec2.internal\" (UID: \"ac0cf868632d3632743a3feebbcd95ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:37:18.089139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.089080 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac0cf868632d3632743a3feebbcd95ab-config\") pod \"kube-apiserver-proxy-ip-10-0-135-87.ec2.internal\" (UID: \"ac0cf868632d3632743a3feebbcd95ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:37:18.089139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.089107 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:37:18.089139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.089123 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:37:18.089321 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.089187 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac0cf868632d3632743a3feebbcd95ab-config\") pod \"kube-apiserver-proxy-ip-10-0-135-87.ec2.internal\" (UID: \"ac0cf868632d3632743a3feebbcd95ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal" Oct 30 18:37:18.089321 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.089189 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:37:18.089321 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.089189 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8836c14af0409d863d60cb41effd982-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" (UID: \"c8836c14af0409d863d60cb41effd982\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:37:18.724727 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.724694 4392 apiserver.go:52] "Watching apiserver" Oct 30 18:37:18.768836 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.768807 4392 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 18:37:18.769239 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.769219 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-2cklg","openshift-ingress-canary/ingress-canary-4mcxv","openshift-multus/multus-9n4ts","openshift-dns/dns-default-5xf4w","openshift-image-registry/node-ca-kbg25","openshift-insights/insights-runtime-extractor-x64kx","kube-system/global-pull-secret-syncer-rsknn","openshift-ovn-kubernetes/ovnkube-node-9mb54","openshift-multus/multus-additional-cni-plugins-d64wt","openshift-network-diagnostics/network-check-target-r8cj4","kube-system/kube-apiserver-proxy-ip-10-0-135-87.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal","kube-system/konnectivity-agent-9lgj6","openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4","openshift-dns/node-resolver-bvrtd","openshift-network-operator/iptables-alerter-zl8dn","openshift-multus/network-metrics-daemon-fkxqh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4"] Oct 30 18:37:18.774245 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.774221 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:18.776307 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.776286 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:18.776641 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.776626 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:18.787859 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.787823 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 18:37:18.787859 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.787828 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.787859 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.787833 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 18:37:18.788059 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.787832 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 18:37:18.788059 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.787853 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.788059 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.787940 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vr4rx\"" Oct 30 18:37:18.788059 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.788035 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 18:37:18.818573 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.818559 4392 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:37:18.842019 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.841998 4392 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 18:37:18.842081 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:18.842042 4392 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-87.ec2.internal" Oct 30 18:37:18.847938 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.847924 4392 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 18:37:18.888517 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.888501 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.888823 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.888807 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.889065 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889048 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 18:37:18.889159 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889102 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.889159 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889148 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.889437 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889424 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 18:37:18.889505 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889481 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.889505 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889501 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.889597 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889571 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.889683 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889648 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d48sc\"" Oct 30 18:37:18.889764 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889698 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.889764 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889758 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.889896 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889874 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dzmp9\"" Oct 30 18:37:18.890026 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889945 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 18:37:18.890026 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889968 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.890026 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889971 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-vjc5x\"" Oct 30 18:37:18.890026 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889990 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5w9ll\"" Oct 30 18:37:18.890026 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890015 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 18:37:18.890268 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890033 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-t7f6r\"" Oct 30 18:37:18.890268 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.889990 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.890268 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890067 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-d56w6\"" Oct 30 18:37:18.890418 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890291 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 18:37:18.890418 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890380 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.890510 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890443 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 18:37:18.890510 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890472 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.890510 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890389 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 18:37:18.890510 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890487 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.890698 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890513 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 18:37:18.890698 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890514 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 18:37:18.890698 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890536 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rbclc\"" Oct 30 18:37:18.890698 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890556 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.890698 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.890627 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.892822 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.892806 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:18.892873 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.892831 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psxhw\" (UniqueName: \"kubernetes.io/projected/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-api-access-psxhw\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:18.892873 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.892849 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-systemd-units\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.892873 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.892865 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-var-lib-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.892976 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.892882 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:18.892976 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.892915 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-device-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.893047 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893015 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-system-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.893080 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893046 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-dbus\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:18.893080 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893070 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-agent-certs\") pod \"konnectivity-agent-9lgj6\" (UID: \"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e\") " pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:37:18.893142 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893133 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-slash\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.893194 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893179 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-kubelet\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.893225 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893208 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-conf-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.893533 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893509 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-agent-certs\") pod \"konnectivity-agent-9lgj6\" (UID: \"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e\") " pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:37:18.893710 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893259 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-system-cni-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.893747 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893730 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-kubelet\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.893776 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893752 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-socket-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.893776 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893767 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-cnibin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.893836 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893784 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-hostroot\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.893836 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893826 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-netd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.893900 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893847 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/697b8251-3b4f-49ff-934e-f0242b39ac2a-data-volume\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:18.893900 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893882 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-tuned\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.893990 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893941 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cnibin\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.894020 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.893991 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/697b8251-3b4f-49ff-934e-f0242b39ac2a-data-volume\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:18.894055 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894037 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-script-lib\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.894088 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894052 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-tuned\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.894088 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894069 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-sys-fs\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.894150 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894092 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-multus\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.894150 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894137 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-kubelet-config\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:18.894214 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894165 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-sys\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.894214 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894196 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-lib-modules\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.894280 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894215 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfm84\" (UniqueName: \"kubernetes.io/projected/252ce72d-90ff-43a0-a76c-6e68ab140aac-kube-api-access-dfm84\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.894645 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894600 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wcbx\" (UniqueName: \"kubernetes.io/projected/e116b674-1f7e-448b-a3c4-08dd88c96ef4-kube-api-access-7wcbx\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.894764 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894661 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-etc-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.894764 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894691 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.894943 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894842 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-bin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.894943 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894877 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-host-slash\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:37:18.894943 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894898 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-modprobe-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.895078 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.894966 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-systemd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.895078 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895005 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-ovn\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.895078 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895063 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/697b8251-3b4f-49ff-934e-f0242b39ac2a-crio-socket\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:18.895223 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895098 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:18.895223 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895132 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-log-socket\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.895223 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895169 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47fb71ba-fd5c-4279-8687-7954945eb63c-ovn-node-metrics-cert\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.895351 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895253 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-cni-binary-copy\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.895351 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895288 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr5ln\" (UniqueName: \"kubernetes.io/projected/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-kube-api-access-pr5ln\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:37:18.895351 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895322 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-config-volume\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:18.895567 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895355 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc45g\" (UniqueName: \"kubernetes.io/projected/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-kube-api-access-hc45g\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:18.895567 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895396 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-tmp-dir\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:37:18.895567 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895431 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.895567 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895467 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-etc-selinux\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.895729 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895587 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-etc-kubernetes\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.895729 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895619 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.895729 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895650 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-env-overrides\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.895729 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895678 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.895729 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895716 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-socket-dir-parent\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.895932 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895751 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-k8s-cni-cncf-io\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.895932 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895780 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-multus-certs\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.895932 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895809 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:18.895932 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895839 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-cert\") pod \"ingress-canary-4mcxv\" (UID: \"5fe7ce49-5f2c-4057-b653-6f20a1eae46f\") " pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:18.895932 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895869 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-daemon-config\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.895932 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895899 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:18.896196 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.895983 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmsfn\" (UniqueName: \"kubernetes.io/projected/e45bb708-24ad-44a5-af48-80ddf8d6e984-kube-api-access-pmsfn\") pod \"migrator-66df5d496b-vpvn4\" (UID: \"e45bb708-24ad-44a5-af48-80ddf8d6e984\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4" Oct 30 18:37:18.896196 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896035 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shclp\" (UniqueName: \"kubernetes.io/projected/a3669583-9579-4c19-a246-8631b75c07f1-kube-api-access-shclp\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:37:18.896196 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896066 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4zhg\" (UniqueName: \"kubernetes.io/projected/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-kube-api-access-w4zhg\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:37:18.896196 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896091 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-tmp\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.896196 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896133 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.896196 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896161 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-registration-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.896196 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896193 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896222 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-netns\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896252 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3669583-9579-4c19-a246-8631b75c07f1-serviceca\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896260 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896279 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896313 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-var-lib-kubelet\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896345 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896374 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896377 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896412 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-config\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896438 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-iptables-alerter-script\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896471 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6dtmn\"" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896515 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 18:37:18.896589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896578 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896624 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896689 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gwgkn\"" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896751 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896795 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896820 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-cni-binary-copy\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896840 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7kr8g\"" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896936 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896470 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3669583-9579-4c19-a246-8631b75c07f1-host\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.896988 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysconfig\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897021 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-systemd\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897027 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-cert\") pod \"ingress-canary-4mcxv\" (UID: \"5fe7ce49-5f2c-4057-b653-6f20a1eae46f\") " pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897052 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-run\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897077 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-node-log\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897111 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvx46\" (UniqueName: \"kubernetes.io/projected/010093ae-c8f4-40f7-82eb-935febcb2c0b-kube-api-access-cvx46\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897115 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252ce72d-90ff-43a0-a76c-6e68ab140aac-tmp\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.897166 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897145 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-hosts-file\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897178 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnlvv\" (UniqueName: \"kubernetes.io/projected/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-kube-api-access-rnlvv\") pod \"ingress-canary-4mcxv\" (UID: \"5fe7ce49-5f2c-4057-b653-6f20a1eae46f\") " pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897225 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-kubernetes\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897250 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-host\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897258 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-daemon-config\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897372 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3669583-9579-4c19-a246-8631b75c07f1-serviceca\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897498 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-config-volume\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897541 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-konnectivity-ca\") pod \"konnectivity-agent-9lgj6\" (UID: \"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e\") " pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897581 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-netns\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897609 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897642 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-bin\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897671 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-conf\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897704 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-binary-copy\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897738 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c76zg\" (UniqueName: \"kubernetes.io/projected/47fb71ba-fd5c-4279-8687-7954945eb63c-kube-api-access-c76zg\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897765 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbg9\" (UniqueName: \"kubernetes.io/projected/d363b0f3-9797-404d-bbf7-f5860726934e-kube-api-access-rpbg9\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897768 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-iptables-alerter-script\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897797 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz9bj\" (UniqueName: \"kubernetes.io/projected/0826e146-9efa-405a-a894-32fd660477de-kube-api-access-dz9bj\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.897866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897870 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-tmp-dir\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897894 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.897996 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-tmp-dir\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898031 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898079 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898100 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898143 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-zcgpq\"" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898209 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r66x4\"" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898235 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-config\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898318 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898373 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9ktdg\"" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898391 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84qrk\"" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898376 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h68zm\"" Oct 30 18:37:18.898502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898464 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-tmp-dir\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:37:18.898957 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898692 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e-konnectivity-ca\") pod \"konnectivity-agent-9lgj6\" (UID: \"bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e\") " pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:37:18.898957 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898734 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-env-overrides\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.898957 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.898813 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cni-binary-copy\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.905000 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.904982 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47fb71ba-fd5c-4279-8687-7954945eb63c-ovnkube-script-lib\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.907213 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.907199 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47fb71ba-fd5c-4279-8687-7954945eb63c-ovn-node-metrics-cert\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.907213 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.907205 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fcc356d-56b0-442e-a80e-6f9d4ad53362-original-pull-secret\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:18.911514 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.911499 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9g9j\" (UniqueName: \"kubernetes.io/projected/a74100cb-b82a-4e6b-a764-c2f090c71913-kube-api-access-m9g9j\") pod \"network-check-target-r8cj4\" (UID: \"a74100cb-b82a-4e6b-a764-c2f090c71913\") " pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:18.911577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.911554 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psxhw\" (UniqueName: \"kubernetes.io/projected/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-api-access-psxhw\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:18.912989 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.912973 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfm84\" (UniqueName: \"kubernetes.io/projected/252ce72d-90ff-43a0-a76c-6e68ab140aac-kube-api-access-dfm84\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.913031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.913008 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wcbx\" (UniqueName: \"kubernetes.io/projected/e116b674-1f7e-448b-a3c4-08dd88c96ef4-kube-api-access-7wcbx\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.914895 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.914880 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr5ln\" (UniqueName: \"kubernetes.io/projected/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-kube-api-access-pr5ln\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:37:18.916497 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.916481 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shclp\" (UniqueName: \"kubernetes.io/projected/a3669583-9579-4c19-a246-8631b75c07f1-kube-api-access-shclp\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:37:18.916550 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.916514 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmsfn\" (UniqueName: \"kubernetes.io/projected/e45bb708-24ad-44a5-af48-80ddf8d6e984-kube-api-access-pmsfn\") pod \"migrator-66df5d496b-vpvn4\" (UID: \"e45bb708-24ad-44a5-af48-80ddf8d6e984\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vpvn4" Oct 30 18:37:18.917534 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.917516 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz9bj\" (UniqueName: \"kubernetes.io/projected/0826e146-9efa-405a-a894-32fd660477de-kube-api-access-dz9bj\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.917534 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.917529 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4zhg\" (UniqueName: \"kubernetes.io/projected/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-kube-api-access-w4zhg\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:37:18.918372 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.918351 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc45g\" (UniqueName: \"kubernetes.io/projected/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-kube-api-access-hc45g\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:18.918445 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.918379 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvx46\" (UniqueName: \"kubernetes.io/projected/010093ae-c8f4-40f7-82eb-935febcb2c0b-kube-api-access-cvx46\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.920165 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.920147 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnlvv\" (UniqueName: \"kubernetes.io/projected/5fe7ce49-5f2c-4057-b653-6f20a1eae46f-kube-api-access-rnlvv\") pod \"ingress-canary-4mcxv\" (UID: \"5fe7ce49-5f2c-4057-b653-6f20a1eae46f\") " pod="openshift-ingress-canary/ingress-canary-4mcxv" Oct 30 18:37:18.920269 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.920255 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbg9\" (UniqueName: \"kubernetes.io/projected/d363b0f3-9797-404d-bbf7-f5860726934e-kube-api-access-rpbg9\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:18.924743 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.924722 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c76zg\" (UniqueName: \"kubernetes.io/projected/47fb71ba-fd5c-4279-8687-7954945eb63c-kube-api-access-c76zg\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.998540 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998481 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.998540 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998508 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-registration-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.998540 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998531 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998552 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-netns\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998571 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998587 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-var-lib-kubelet\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998609 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3669583-9579-4c19-a246-8631b75c07f1-host\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998613 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998633 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysconfig\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998613 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-registration-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998640 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998653 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-systemd\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998677 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-var-lib-kubelet\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998686 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3669583-9579-4c19-a246-8631b75c07f1-host\") pod \"node-ca-kbg25\" (UID: \"a3669583-9579-4c19-a246-8631b75c07f1\") " pod="openshift-image-registry/node-ca-kbg25" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998640 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-netns\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998690 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-run\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998702 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-systemd\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998690 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysconfig\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:18.998724 4392 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998738 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-node-log\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.998766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998763 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-hosts-file\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998785 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-kubernetes\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998784 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-node-log\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:18.998802 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:19.498785137 +0000 UTC m=+1.861798497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : secret "insights-runtime-extractor-tls" not found Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998727 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-run\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998813 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-kubernetes\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998830 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-host\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998839 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0-hosts-file\") pod \"node-resolver-bvrtd\" (UID: \"a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0\") " pod="openshift-dns/node-resolver-bvrtd" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998857 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-host\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998857 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-netns\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998879 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-netns\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998886 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998931 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-bin\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998939 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998955 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-conf\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998976 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-bin\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.998991 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-systemd-units\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999013 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-var-lib-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999034 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999056 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-device-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999074 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-conf\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999080 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-system-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999077 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-systemd-units\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999111 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-dbus\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999092 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-var-lib-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999125 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-device-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:18.999130 4392 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999170 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-dbus\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999173 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-system-cni-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999172 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-slash\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:18.999192 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:19.499181961 +0000 UTC m=+1.862195319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : secret "metrics-daemon-secret" not found Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999130 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-slash\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999216 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-kubelet\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999239 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-conf-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999256 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-system-cni-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999259 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-kubelet\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999269 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-kubelet\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999284 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-socket-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999331 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-conf-dir\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999337 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-socket-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999330 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-kubelet\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999351 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-cnibin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999373 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-hostroot\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:18.999361 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999387 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-netd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999401 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-cnibin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999404 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cnibin\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999426 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-sys-fs\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999332 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-system-cni-dir\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999441 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e116b674-1f7e-448b-a3c4-08dd88c96ef4-cnibin\") pod \"multus-additional-cni-plugins-d64wt\" (UID: \"e116b674-1f7e-448b-a3c4-08dd88c96ef4\") " pod="openshift-multus/multus-additional-cni-plugins-d64wt" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999445 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-multus\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999450 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-hostroot\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999473 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-cni-netd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999475 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-multus\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999474 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-kubelet-config\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999499 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fcc356d-56b0-442e-a80e-6f9d4ad53362-kubelet-config\") pod \"global-pull-secret-syncer-rsknn\" (UID: \"3fcc356d-56b0-442e-a80e-6f9d4ad53362\") " pod="kube-system/global-pull-secret-syncer-rsknn" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999509 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-sys\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999531 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-lib-modules\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999535 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-sys-fs\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999546 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-etc-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999563 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999586 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-bin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999608 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999610 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-host-slash\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999621 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-sys\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999634 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-var-lib-cni-bin\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999610 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-etc-openvswitch\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999655 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-modprobe-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999673 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba11b962-ce4c-4b4a-9b1f-19ac22a0613b-host-slash\") pod \"iptables-alerter-zl8dn\" (UID: \"ba11b962-ce4c-4b4a-9b1f-19ac22a0613b\") " pod="openshift-network-operator/iptables-alerter-zl8dn" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999696 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-lib-modules\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999699 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-systemd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999715 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-ovn\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999749 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/697b8251-3b4f-49ff-934e-f0242b39ac2a-crio-socket\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999759 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-ovn\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999762 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-run-systemd\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999781 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999799 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-modprobe-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999799 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/697b8251-3b4f-49ff-934e-f0242b39ac2a-crio-socket\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999842 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-log-socket\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999884 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-log-socket\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999892 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999924 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-etc-selinux\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999939 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-etc-kubernetes\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999964 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-etc-kubernetes\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999990 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-etc-selinux\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:18.999979 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47fb71ba-fd5c-4279-8687-7954945eb63c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mb54\" (UID: \"47fb71ba-fd5c-4279-8687-7954945eb63c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000013 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000044 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000069 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-socket-dir-parent\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000094 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-k8s-cni-cncf-io\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000097 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0826e146-9efa-405a-a894-32fd660477de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dn4z4\" (UID: \"0826e146-9efa-405a-a894-32fd660477de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dn4z4" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000121 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/252ce72d-90ff-43a0-a76c-6e68ab140aac-etc-sysctl-d\") pod \"tuned-2cklg\" (UID: \"252ce72d-90ff-43a0-a76c-6e68ab140aac\") " pod="openshift-cluster-node-tuning-operator/tuned-2cklg" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000138 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-multus-certs\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000146 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-multus-socket-dir-parent\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000158 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000165 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-multus-certs\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000126 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/010093ae-c8f4-40f7-82eb-935febcb2c0b-host-run-k8s-cni-cncf-io\") pod \"multus-9n4ts\" (UID: \"010093ae-c8f4-40f7-82eb-935febcb2c0b\") " pod="openshift-multus/multus-9n4ts" Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:19.000209 4392 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:19.000254 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls podName:f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:19.500239145 +0000 UTC m=+1.863252504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls") pod "dns-default-5xf4w" (UID: "f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e") : secret "dns-default-metrics-tls" not found Oct 30 18:37:19.000594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.000297 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/697b8251-3b4f-49ff-934e-f0242b39ac2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:19.504635 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.504602 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:19.504816 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.504658 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:19.504816 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:19.504778 4392 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:37:19.504955 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:19.504827 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:19.504955 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:19.504851 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:20.504831702 +0000 UTC m=+2.867845058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : secret "metrics-daemon-secret" not found Oct 30 18:37:19.504955 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:19.504929 4392 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:37:19.505074 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:19.504981 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:20.504970458 +0000 UTC m=+2.867983802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : secret "insights-runtime-extractor-tls" not found Oct 30 18:37:19.505074 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:19.504933 4392 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:37:19.505074 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:19.505050 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls podName:f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:20.505039256 +0000 UTC m=+2.868052599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls") pod "dns-default-5xf4w" (UID: "f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e") : secret "dns-default-metrics-tls" not found Oct 30 18:37:20.394535 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:20.394505 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bvrtd_a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0/dns-node-resolver/0.log" Oct 30 18:37:20.510742 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:20.510707 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:20.510927 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:20.510758 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:20.510927 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:20.510808 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:20.510927 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:20.510860 4392 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:37:20.510927 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:20.510898 4392 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:37:20.511122 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:20.510942 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:22.510922822 +0000 UTC m=+4.873936178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : secret "insights-runtime-extractor-tls" not found Oct 30 18:37:20.511122 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:20.510959 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:22.510952129 +0000 UTC m=+4.873965473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : secret "metrics-daemon-secret" not found Oct 30 18:37:20.511251 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:20.511217 4392 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 18:37:20.513246 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:20.513215 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e-metrics-tls\") pod \"dns-default-5xf4w\" (UID: \"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e\") " pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:20.576833 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:20.576812 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:20.888806 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:20.888774 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5xf4w"] Oct 30 18:37:20.892625 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:20.892600 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64e4d3c_7d14_4a8d_95d7_9037dc6acf3e.slice/crio-e4b943293e629d441f6ff6e2acdc7954db0ebc42ec437ab61614ef5428cc0228 WatchSource:0}: Error finding container e4b943293e629d441f6ff6e2acdc7954db0ebc42ec437ab61614ef5428cc0228: Status 404 returned error can't find the container with id e4b943293e629d441f6ff6e2acdc7954db0ebc42ec437ab61614ef5428cc0228 Oct 30 18:37:20.894830 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:20.894810 4392 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 18:37:21.534528 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:21.534497 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:21.788988 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:21.788919 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kbg25_a3669583-9579-4c19-a246-8631b75c07f1/node-ca/0.log" Oct 30 18:37:21.827095 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:21.827060 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xf4w" event={"ID":"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e","Type":"ContainerStarted","Data":"e4b943293e629d441f6ff6e2acdc7954db0ebc42ec437ab61614ef5428cc0228"} Oct 30 18:37:22.189314 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:22.189252 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4mcxv_5fe7ce49-5f2c-4057-b653-6f20a1eae46f/serve-healthcheck-canary/0.log" Oct 30 18:37:22.525915 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:22.525869 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:22.526058 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:22.525937 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:22.526058 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:22.526022 4392 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:37:22.526163 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:22.526059 4392 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:37:22.526163 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:22.526082 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:26.526068209 +0000 UTC m=+8.889081553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : secret "insights-runtime-extractor-tls" not found Oct 30 18:37:22.526163 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:22.526112 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:26.526095447 +0000 UTC m=+8.889108808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : secret "metrics-daemon-secret" not found Oct 30 18:37:22.830644 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:22.830547 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xf4w" event={"ID":"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e","Type":"ContainerStarted","Data":"36a9d2ef2c9754032d7b53ced3ee3e333aa5e534487a7472c2e7788c4a0c0703"} Oct 30 18:37:22.830644 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:22.830605 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xf4w" event={"ID":"f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e","Type":"ContainerStarted","Data":"ca037636ef31d36fb2d667becaaec78dbfd5f071e960f29f6e1151216a9f1af5"} Oct 30 18:37:22.831077 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:22.830652 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:22.896478 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:22.896450 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:23.569288 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:23.569257 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:23.833391 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:23.833314 4392 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 18:37:26.552742 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:26.552696 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:26.553167 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:26.552759 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:26.553167 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:26.552851 4392 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:37:26.553167 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:26.552862 4392 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:37:26.553167 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:26.552928 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls podName:697b8251-3b4f-49ff-934e-f0242b39ac2a nodeName:}" failed. No retries permitted until 2026-10-30 18:37:34.552897054 +0000 UTC m=+16.915910402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x64kx" (UID: "697b8251-3b4f-49ff-934e-f0242b39ac2a") : secret "insights-runtime-extractor-tls" not found Oct 30 18:37:26.553167 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:26.552968 4392 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs podName:d363b0f3-9797-404d-bbf7-f5860726934e nodeName:}" failed. No retries permitted until 2026-10-30 18:37:34.552948034 +0000 UTC m=+16.915961381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs") pod "network-metrics-daemon-fkxqh" (UID: "d363b0f3-9797-404d-bbf7-f5860726934e") : secret "metrics-daemon-secret" not found Oct 30 18:37:29.348033 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:29.348006 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mb54" Oct 30 18:37:32.836043 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:32.836013 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5xf4w" Oct 30 18:37:34.609529 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:34.609477 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:34.610048 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:34.609544 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:34.611778 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:34.611752 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363b0f3-9797-404d-bbf7-f5860726934e-metrics-certs\") pod \"network-metrics-daemon-fkxqh\" (UID: \"d363b0f3-9797-404d-bbf7-f5860726934e\") " pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:34.611891 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:34.611866 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697b8251-3b4f-49ff-934e-f0242b39ac2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x64kx\" (UID: \"697b8251-3b4f-49ff-934e-f0242b39ac2a\") " pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:34.674974 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:34.674941 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkxqh" Oct 30 18:37:34.677098 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:34.677080 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x64kx" Oct 30 18:37:34.994966 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:34.994935 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fkxqh"] Oct 30 18:37:34.998573 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:34.998542 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd363b0f3_9797_404d_bbf7_f5860726934e.slice/crio-de5caef82900a36f03d99588cc8740abb79471bc80b8ae12e5a4b328b9f44906 WatchSource:0}: Error finding container de5caef82900a36f03d99588cc8740abb79471bc80b8ae12e5a4b328b9f44906: Status 404 returned error can't find the container with id de5caef82900a36f03d99588cc8740abb79471bc80b8ae12e5a4b328b9f44906 Oct 30 18:37:35.013377 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:35.013340 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x64kx"] Oct 30 18:37:35.015793 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:35.015765 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697b8251_3b4f_49ff_934e_f0242b39ac2a.slice/crio-c5d0dcb9fbdb6990f295c2f6f5745f4770eaa2707c119b2457907405c5cc9881 WatchSource:0}: Error finding container c5d0dcb9fbdb6990f295c2f6f5745f4770eaa2707c119b2457907405c5cc9881: Status 404 returned error can't find the container with id c5d0dcb9fbdb6990f295c2f6f5745f4770eaa2707c119b2457907405c5cc9881 Oct 30 18:37:35.862393 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:35.862354 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x64kx" event={"ID":"697b8251-3b4f-49ff-934e-f0242b39ac2a","Type":"ContainerStarted","Data":"fa4e999a3659c10475beee7dc680baec9a97b343469d0bf3e0238ca45b955b5b"} Oct 30 18:37:35.862764 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:35.862417 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x64kx" event={"ID":"697b8251-3b4f-49ff-934e-f0242b39ac2a","Type":"ContainerStarted","Data":"fc31adfe99d5d9260bc903cfe07a584f2f318a910666a868200616848ef9f9ea"} Oct 30 18:37:35.862764 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:35.862441 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x64kx" event={"ID":"697b8251-3b4f-49ff-934e-f0242b39ac2a","Type":"ContainerStarted","Data":"c5d0dcb9fbdb6990f295c2f6f5745f4770eaa2707c119b2457907405c5cc9881"} Oct 30 18:37:35.863413 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:35.863390 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fkxqh" event={"ID":"d363b0f3-9797-404d-bbf7-f5860726934e","Type":"ContainerStarted","Data":"de5caef82900a36f03d99588cc8740abb79471bc80b8ae12e5a4b328b9f44906"} Oct 30 18:37:36.870593 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:36.870561 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fkxqh" event={"ID":"d363b0f3-9797-404d-bbf7-f5860726934e","Type":"ContainerStarted","Data":"b822072d68c12745ec5006257597d878113465194ac14f37c8e93a2805d61823"} Oct 30 18:37:36.870992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:36.870651 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fkxqh" event={"ID":"d363b0f3-9797-404d-bbf7-f5860726934e","Type":"ContainerStarted","Data":"0fd240bab341b2a24f028ddad1ad093588cad79f7ee225dba09c2432fe0efeec"} Oct 30 18:37:37.875143 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:37.875103 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x64kx" event={"ID":"697b8251-3b4f-49ff-934e-f0242b39ac2a","Type":"ContainerStarted","Data":"b4546dbc4998b1abe2d70ee7833935af41bc8008c1ea70d19cef07387dc9136f"} Oct 30 18:37:41.670936 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.670888 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-nnv76"] Oct 30 18:37:41.674095 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.674070 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-nnv76" Oct 30 18:37:41.684288 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.684268 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz"] Oct 30 18:37:41.687008 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.686991 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz" Oct 30 18:37:41.701063 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.701039 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-czhnq\"" Oct 30 18:37:41.713513 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.713490 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz"] Oct 30 18:37:41.713662 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.713621 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 18:37:41.713728 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.713714 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 18:37:41.713877 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.713861 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Oct 30 18:37:41.713962 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.713947 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jfh7g\"" Oct 30 18:37:41.714351 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.714337 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-nnv76"] Oct 30 18:37:41.756066 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.756043 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b87df89-bda3-4bfb-8d51-b143ab8fd67e-tmp\") pod \"downloads-6dd789c8b7-nnv76\" (UID: \"0b87df89-bda3-4bfb-8d51-b143ab8fd67e\") " pod="openshift-console/downloads-6dd789c8b7-nnv76" Oct 30 18:37:41.756165 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.756084 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2q9t\" (UniqueName: \"kubernetes.io/projected/0b87df89-bda3-4bfb-8d51-b143ab8fd67e-kube-api-access-b2q9t\") pod \"downloads-6dd789c8b7-nnv76\" (UID: \"0b87df89-bda3-4bfb-8d51-b143ab8fd67e\") " pod="openshift-console/downloads-6dd789c8b7-nnv76" Oct 30 18:37:41.856838 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.856812 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2q9t\" (UniqueName: \"kubernetes.io/projected/0b87df89-bda3-4bfb-8d51-b143ab8fd67e-kube-api-access-b2q9t\") pod \"downloads-6dd789c8b7-nnv76\" (UID: \"0b87df89-bda3-4bfb-8d51-b143ab8fd67e\") " pod="openshift-console/downloads-6dd789c8b7-nnv76" Oct 30 18:37:41.856994 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.856856 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b87df89-bda3-4bfb-8d51-b143ab8fd67e-tmp\") pod \"downloads-6dd789c8b7-nnv76\" (UID: \"0b87df89-bda3-4bfb-8d51-b143ab8fd67e\") " pod="openshift-console/downloads-6dd789c8b7-nnv76" Oct 30 18:37:41.856994 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.856919 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b3ce7149-ac36-45f5-ad3a-feb3acb03ded-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-4h6vz\" (UID: \"b3ce7149-ac36-45f5-ad3a-feb3acb03ded\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz" Oct 30 18:37:41.857400 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.857382 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b87df89-bda3-4bfb-8d51-b143ab8fd67e-tmp\") pod \"downloads-6dd789c8b7-nnv76\" (UID: \"0b87df89-bda3-4bfb-8d51-b143ab8fd67e\") " pod="openshift-console/downloads-6dd789c8b7-nnv76" Oct 30 18:37:41.877027 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.877006 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2q9t\" (UniqueName: \"kubernetes.io/projected/0b87df89-bda3-4bfb-8d51-b143ab8fd67e-kube-api-access-b2q9t\") pod \"downloads-6dd789c8b7-nnv76\" (UID: \"0b87df89-bda3-4bfb-8d51-b143ab8fd67e\") " pod="openshift-console/downloads-6dd789c8b7-nnv76" Oct 30 18:37:41.957583 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.957561 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b3ce7149-ac36-45f5-ad3a-feb3acb03ded-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-4h6vz\" (UID: \"b3ce7149-ac36-45f5-ad3a-feb3acb03ded\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz" Oct 30 18:37:41.959829 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.959809 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b3ce7149-ac36-45f5-ad3a-feb3acb03ded-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-4h6vz\" (UID: \"b3ce7149-ac36-45f5-ad3a-feb3acb03ded\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz" Oct 30 18:37:41.985842 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.985818 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-nnv76" Oct 30 18:37:41.996985 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:41.996967 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz" Oct 30 18:37:42.311602 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:42.311511 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz"] Oct 30 18:37:42.314163 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:42.314139 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-nnv76"] Oct 30 18:37:42.315079 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:42.315022 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ce7149_ac36_45f5_ad3a_feb3acb03ded.slice/crio-cd5662ddec185c484f277741e1ed19e7a7aef80923ad5ec4fc7217355f233ae8 WatchSource:0}: Error finding container cd5662ddec185c484f277741e1ed19e7a7aef80923ad5ec4fc7217355f233ae8: Status 404 returned error can't find the container with id cd5662ddec185c484f277741e1ed19e7a7aef80923ad5ec4fc7217355f233ae8 Oct 30 18:37:42.328794 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:42.328772 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b87df89_bda3_4bfb_8d51_b143ab8fd67e.slice/crio-b70aefe35160dcc67a587d97942d518848414d61350efe5834612e1bfcf9ddf2 WatchSource:0}: Error finding container b70aefe35160dcc67a587d97942d518848414d61350efe5834612e1bfcf9ddf2: Status 404 returned error can't find the container with id b70aefe35160dcc67a587d97942d518848414d61350efe5834612e1bfcf9ddf2 Oct 30 18:37:42.892463 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:42.892423 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-nnv76" event={"ID":"0b87df89-bda3-4bfb-8d51-b143ab8fd67e","Type":"ContainerStarted","Data":"b70aefe35160dcc67a587d97942d518848414d61350efe5834612e1bfcf9ddf2"} Oct 30 18:37:42.894995 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:42.894933 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz" event={"ID":"b3ce7149-ac36-45f5-ad3a-feb3acb03ded","Type":"ContainerStarted","Data":"cd5662ddec185c484f277741e1ed19e7a7aef80923ad5ec4fc7217355f233ae8"} Oct 30 18:37:43.900365 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:43.900324 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz" event={"ID":"b3ce7149-ac36-45f5-ad3a-feb3acb03ded","Type":"ContainerStarted","Data":"9e628d14a9af79a684cbc33937f6624c26d76dfa54b7c779c2ac474412102306"} Oct 30 18:37:43.900820 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:43.900705 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz" Oct 30 18:37:43.905982 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:43.905958 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz" Oct 30 18:37:43.945048 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:43.944994 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4h6vz" podStartSLOduration=1.982206688 podStartE2EDuration="2.944982751s" totalImagesPullingTime="962.776063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:43.944731686 +0000 UTC m=+26.307745052" watchObservedRunningTime="2026-10-30 18:37:43.944982751 +0000 UTC m=+26.307996111" Oct 30 18:37:45.202419 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:45.202384 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9lgj6" Oct 30 18:37:49.062936 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.062883 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc"] Oct 30 18:37:49.101200 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.101167 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc"] Oct 30 18:37:49.101377 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.101304 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.105623 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.105592 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj"] Oct 30 18:37:49.119438 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.119419 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.121412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.120780 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bkznn"] Oct 30 18:37:49.121412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.121375 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 18:37:49.133410 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.133380 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 18:37:49.133410 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.133392 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Oct 30 18:37:49.133611 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.133438 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Oct 30 18:37:49.133611 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.133446 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fcr4f\"" Oct 30 18:37:49.133611 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.133470 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 18:37:49.137535 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.137507 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Oct 30 18:37:49.140932 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.140902 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Oct 30 18:37:49.141035 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.141018 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nqlvv\"" Oct 30 18:37:49.143468 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.143450 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Oct 30 18:37:49.145718 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.145701 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj"] Oct 30 18:37:49.145809 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.145797 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.162666 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.162645 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 18:37:49.171756 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.171739 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zvl8z\"" Oct 30 18:37:49.171844 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.171780 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 18:37:49.171889 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.171845 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 18:37:49.204486 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.204455 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.204601 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.204502 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.204601 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.204583 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.204689 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.204619 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qxbq\" (UniqueName: \"kubernetes.io/projected/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-api-access-8qxbq\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.204689 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.204651 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cba85998-7f86-4815-8ed0-13a5e8013792-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.204800 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.204773 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.204848 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.204799 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cba85998-7f86-4815-8ed0-13a5e8013792-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.204848 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.204822 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8npz\" (UniqueName: \"kubernetes.io/projected/cba85998-7f86-4815-8ed0-13a5e8013792-kube-api-access-c8npz\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.204988 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.204849 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.204988 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.204968 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cba85998-7f86-4815-8ed0-13a5e8013792-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.305355 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305318 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b02c4350-6bbd-443b-83e6-3a5bb737f771-sys\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.305533 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305377 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.305533 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305457 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.305533 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305498 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-textfile\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.305690 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305537 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.305690 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305567 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qxbq\" (UniqueName: \"kubernetes.io/projected/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-api-access-8qxbq\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.305690 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305593 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cba85998-7f86-4815-8ed0-13a5e8013792-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.305690 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305659 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-wtmp\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.305963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305694 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-tls\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.305963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305729 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8npz\" (UniqueName: \"kubernetes.io/projected/cba85998-7f86-4815-8ed0-13a5e8013792-kube-api-access-c8npz\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.305963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305763 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-accelerators-collector-config\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.305963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305800 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cba85998-7f86-4815-8ed0-13a5e8013792-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.305963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305830 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.305963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305856 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txthz\" (UniqueName: \"kubernetes.io/projected/b02c4350-6bbd-443b-83e6-3a5bb737f771-kube-api-access-txthz\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.305963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305887 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b02c4350-6bbd-443b-83e6-3a5bb737f771-metrics-client-ca\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.305963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305923 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.305963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305941 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.306494 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.305986 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.306494 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.306288 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cba85998-7f86-4815-8ed0-13a5e8013792-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.306494 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.306332 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cba85998-7f86-4815-8ed0-13a5e8013792-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.306645 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.306613 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b02c4350-6bbd-443b-83e6-3a5bb737f771-root\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.306733 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.306712 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.307257 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.307234 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.308973 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.308950 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.309073 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.309056 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cba85998-7f86-4815-8ed0-13a5e8013792-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.309144 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.309114 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cba85998-7f86-4815-8ed0-13a5e8013792-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.310420 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.310400 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.327541 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.327483 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qxbq\" (UniqueName: \"kubernetes.io/projected/b13b12dd-1988-49b8-ac7a-e6be3e7c6c64-kube-api-access-8qxbq\") pod \"kube-state-metrics-5dc8d7d89b-nl9qj\" (UID: \"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.329163 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.329135 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8npz\" (UniqueName: \"kubernetes.io/projected/cba85998-7f86-4815-8ed0-13a5e8013792-kube-api-access-c8npz\") pod \"openshift-state-metrics-7bd7489957-ln2qc\" (UID: \"cba85998-7f86-4815-8ed0-13a5e8013792\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.407050 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407017 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-textfile\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407193 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407075 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-wtmp\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407193 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407105 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-tls\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407193 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407138 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-accelerators-collector-config\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407193 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407172 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407193 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407195 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txthz\" (UniqueName: \"kubernetes.io/projected/b02c4350-6bbd-443b-83e6-3a5bb737f771-kube-api-access-txthz\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407451 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407213 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b02c4350-6bbd-443b-83e6-3a5bb737f771-metrics-client-ca\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407451 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407243 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b02c4350-6bbd-443b-83e6-3a5bb737f771-root\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407451 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407270 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b02c4350-6bbd-443b-83e6-3a5bb737f771-sys\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407451 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407277 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-wtmp\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407451 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407347 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b02c4350-6bbd-443b-83e6-3a5bb737f771-sys\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407451 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407399 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b02c4350-6bbd-443b-83e6-3a5bb737f771-root\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407451 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407431 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-textfile\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407815 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407787 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-accelerators-collector-config\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.407942 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.407857 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b02c4350-6bbd-443b-83e6-3a5bb737f771-metrics-client-ca\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.409954 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.409930 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.410059 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.409982 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b02c4350-6bbd-443b-83e6-3a5bb737f771-node-exporter-tls\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.428479 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.428461 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txthz\" (UniqueName: \"kubernetes.io/projected/b02c4350-6bbd-443b-83e6-3a5bb737f771-kube-api-access-txthz\") pod \"node-exporter-bkznn\" (UID: \"b02c4350-6bbd-443b-83e6-3a5bb737f771\") " pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.452383 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.452361 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" Oct 30 18:37:49.503917 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.503872 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" Oct 30 18:37:49.555451 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.555222 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bkznn" Oct 30 18:37:49.601858 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:49.601823 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02c4350_6bbd_443b_83e6_3a5bb737f771.slice/crio-e874bccbd2e5570271fc666a5add95201c39239e1201977821623866ae62f66d WatchSource:0}: Error finding container e874bccbd2e5570271fc666a5add95201c39239e1201977821623866ae62f66d: Status 404 returned error can't find the container with id e874bccbd2e5570271fc666a5add95201c39239e1201977821623866ae62f66d Oct 30 18:37:49.796181 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.796142 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc"] Oct 30 18:37:49.800365 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:49.800338 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba85998_7f86_4815_8ed0_13a5e8013792.slice/crio-917671296d3997cadd83d14c0f3b83950db19cf95d5123833a1396144d42df44 WatchSource:0}: Error finding container 917671296d3997cadd83d14c0f3b83950db19cf95d5123833a1396144d42df44: Status 404 returned error can't find the container with id 917671296d3997cadd83d14c0f3b83950db19cf95d5123833a1396144d42df44 Oct 30 18:37:49.840244 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.840120 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj"] Oct 30 18:37:49.850100 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:49.849983 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13b12dd_1988_49b8_ac7a_e6be3e7c6c64.slice/crio-3da30917506228d695c327ecb3ecf898fc4c6ac6b14b0c4ed3248cbc78f413fb WatchSource:0}: Error finding container 3da30917506228d695c327ecb3ecf898fc4c6ac6b14b0c4ed3248cbc78f413fb: Status 404 returned error can't find the container with id 3da30917506228d695c327ecb3ecf898fc4c6ac6b14b0c4ed3248cbc78f413fb Oct 30 18:37:49.922678 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.922652 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkznn" event={"ID":"b02c4350-6bbd-443b-83e6-3a5bb737f771","Type":"ContainerStarted","Data":"e874bccbd2e5570271fc666a5add95201c39239e1201977821623866ae62f66d"} Oct 30 18:37:49.924469 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.924353 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" event={"ID":"cba85998-7f86-4815-8ed0-13a5e8013792","Type":"ContainerStarted","Data":"484e100d550f4bc955cb9d58ff80d9fc4f86f28e7d11f74e97825ba58b6563ce"} Oct 30 18:37:49.924469 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.924413 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" event={"ID":"cba85998-7f86-4815-8ed0-13a5e8013792","Type":"ContainerStarted","Data":"917671296d3997cadd83d14c0f3b83950db19cf95d5123833a1396144d42df44"} Oct 30 18:37:49.925624 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:49.925598 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" event={"ID":"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64","Type":"ContainerStarted","Data":"3da30917506228d695c327ecb3ecf898fc4c6ac6b14b0c4ed3248cbc78f413fb"} Oct 30 18:37:50.931063 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:50.931032 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" event={"ID":"cba85998-7f86-4815-8ed0-13a5e8013792","Type":"ContainerStarted","Data":"3d15f0abeb821bad905e99d752166bf89d50ffd10a0e7660c1edbbe452d88433"} Oct 30 18:37:51.538119 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.538038 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r8cj4" Oct 30 18:37:51.542721 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.542687 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7df7867bcc-pjv7q"] Oct 30 18:37:51.560060 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.560034 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7df7867bcc-pjv7q"] Oct 30 18:37:51.560217 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.560156 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.641581 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.641549 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Oct 30 18:37:51.641736 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.641601 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Oct 30 18:37:51.641736 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.641652 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-94sc7\"" Oct 30 18:37:51.641736 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.641698 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Oct 30 18:37:51.641736 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.641699 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-euotmetbv0q28\"" Oct 30 18:37:51.641869 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.641752 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Oct 30 18:37:51.641869 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.641798 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Oct 30 18:37:51.725024 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.724990 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.725024 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.725025 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-grpc-tls\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.725201 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.725050 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.725201 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.725137 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-tls\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.725201 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.725188 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.725342 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.725237 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b7a2de-aadb-42b6-ae13-77588a054e3e-metrics-client-ca\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.725401 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.725384 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b7a2de-aadb-42b6-ae13-77588a054e3e-tmp\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.725432 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.725419 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.725520 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.725439 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s82md\" (UniqueName: \"kubernetes.io/projected/a6b7a2de-aadb-42b6-ae13-77588a054e3e-kube-api-access-s82md\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.826901 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.826823 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.826901 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.826860 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-grpc-tls\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.827139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.826900 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.827139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.826965 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-tls\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.827139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.826999 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.827139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.827026 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b7a2de-aadb-42b6-ae13-77588a054e3e-metrics-client-ca\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.827139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.827062 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b7a2de-aadb-42b6-ae13-77588a054e3e-tmp\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.827139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.827093 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.827139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.827117 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s82md\" (UniqueName: \"kubernetes.io/projected/a6b7a2de-aadb-42b6-ae13-77588a054e3e-kube-api-access-s82md\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.827899 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.827865 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b7a2de-aadb-42b6-ae13-77588a054e3e-metrics-client-ca\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.828191 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.828171 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b7a2de-aadb-42b6-ae13-77588a054e3e-tmp\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.829902 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.829875 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.830042 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.829949 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-grpc-tls\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.830611 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.830585 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.830975 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.830957 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.831192 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.831169 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.831620 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.831579 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6b7a2de-aadb-42b6-ae13-77588a054e3e-secret-thanos-querier-tls\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.848093 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.848074 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s82md\" (UniqueName: \"kubernetes.io/projected/a6b7a2de-aadb-42b6-ae13-77588a054e3e-kube-api-access-s82md\") pod \"thanos-querier-7df7867bcc-pjv7q\" (UID: \"a6b7a2de-aadb-42b6-ae13-77588a054e3e\") " pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:51.940486 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.940450 4392 generic.go:356] "Generic (PLEG): container finished" podID="b02c4350-6bbd-443b-83e6-3a5bb737f771" containerID="c7499946e8c5bac43f3f9cb622157b23d845e1533af2baff29ba82fb96d46350" exitCode=0 Oct 30 18:37:51.940963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.940519 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkznn" event={"ID":"b02c4350-6bbd-443b-83e6-3a5bb737f771","Type":"ContainerDied","Data":"c7499946e8c5bac43f3f9cb622157b23d845e1533af2baff29ba82fb96d46350"} Oct 30 18:37:51.982231 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:51.982112 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:52.363216 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:52.363139 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7df7867bcc-pjv7q"] Oct 30 18:37:52.381974 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:52.381932 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b7a2de_aadb_42b6_ae13_77588a054e3e.slice/crio-dc37dad1d7ab66cab2792aa7da502a4c9ce3c1b7bc23318f79d9f77f2a380e25 WatchSource:0}: Error finding container dc37dad1d7ab66cab2792aa7da502a4c9ce3c1b7bc23318f79d9f77f2a380e25: Status 404 returned error can't find the container with id dc37dad1d7ab66cab2792aa7da502a4c9ce3c1b7bc23318f79d9f77f2a380e25 Oct 30 18:37:52.947882 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:52.947840 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkznn" event={"ID":"b02c4350-6bbd-443b-83e6-3a5bb737f771","Type":"ContainerStarted","Data":"6f05c58ed709ba4b71baede121b385c73aa842d31d47c511434669820a32c89e"} Oct 30 18:37:52.948460 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:52.947942 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkznn" event={"ID":"b02c4350-6bbd-443b-83e6-3a5bb737f771","Type":"ContainerStarted","Data":"5d095019d512a9320cf6faee6b40d265d54c00cf078d0a59c77662c8dd3bd7a6"} Oct 30 18:37:52.949851 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:52.949822 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" event={"ID":"a6b7a2de-aadb-42b6-ae13-77588a054e3e","Type":"ContainerStarted","Data":"dc37dad1d7ab66cab2792aa7da502a4c9ce3c1b7bc23318f79d9f77f2a380e25"} Oct 30 18:37:52.952576 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:52.952548 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" event={"ID":"cba85998-7f86-4815-8ed0-13a5e8013792","Type":"ContainerStarted","Data":"28a805cc44b2ed217e66a8da9406477259534d275e3bc5bb2cc8e59b42f6143e"} Oct 30 18:37:52.955283 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:52.955255 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" event={"ID":"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64","Type":"ContainerStarted","Data":"38738a2f1d575b8b0192e4e2705c9eb1a3aa5823b4d09738b5faf6781cc899c4"} Oct 30 18:37:52.955367 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:52.955307 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" event={"ID":"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64","Type":"ContainerStarted","Data":"59bf27120e3f0a7426bc761565472310c9ad6d101dab9e09b74ee07c096b7ad2"} Oct 30 18:37:52.955367 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:52.955339 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" event={"ID":"b13b12dd-1988-49b8-ac7a-e6be3e7c6c64","Type":"ContainerStarted","Data":"c433b94428070acf7fbb970279268e23199ab8be540529e259eac585fc77ece0"} Oct 30 18:37:52.994563 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:52.994511 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bkznn" podStartSLOduration=2.418707362 podStartE2EDuration="3.994493512s" totalImagesPullingTime="1.49763052s" totalInitContainerRuntime="78.15563ms" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:52.994155216 +0000 UTC m=+35.357168583" watchObservedRunningTime="2026-10-30 18:37:52.994493512 +0000 UTC m=+35.357506882" Oct 30 18:37:53.043977 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.043919 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-nl9qj" podStartSLOduration=1.9376774559999999 podStartE2EDuration="4.043881197s" totalImagesPullingTime="2.106203741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:53.042870809 +0000 UTC m=+35.405884174" watchObservedRunningTime="2026-10-30 18:37:53.043881197 +0000 UTC m=+35.406894564" Oct 30 18:37:53.092824 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.092023 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ln2qc" podStartSLOduration=2.135492258 podStartE2EDuration="4.092004735s" totalImagesPullingTime="1.956512477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:53.091497966 +0000 UTC m=+35.454511333" watchObservedRunningTime="2026-10-30 18:37:53.092004735 +0000 UTC m=+35.455018102" Oct 30 18:37:53.581937 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.581160 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6687598896-72zcj"] Oct 30 18:37:53.584544 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.584524 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.616947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.616927 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 30 18:37:53.617087 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.616975 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 30 18:37:53.618252 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.618224 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6687598896-72zcj"] Oct 30 18:37:53.672305 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.672274 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 30 18:37:53.672452 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.672354 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 30 18:37:53.672452 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.672372 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5stf0prkdk55d\"" Oct 30 18:37:53.672452 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.672459 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j4ws2\"" Oct 30 18:37:53.743211 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.743174 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4b0a400d-59c2-459d-8f2c-ac39870c8973-secret-metrics-server-tls\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.743391 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.743258 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9nc2\" (UniqueName: \"kubernetes.io/projected/4b0a400d-59c2-459d-8f2c-ac39870c8973-kube-api-access-x9nc2\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.743391 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.743289 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4b0a400d-59c2-459d-8f2c-ac39870c8973-audit-log\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.743391 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.743318 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4b0a400d-59c2-459d-8f2c-ac39870c8973-metrics-server-audit-profiles\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.743391 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.743352 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b0a400d-59c2-459d-8f2c-ac39870c8973-client-ca-bundle\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.743391 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.743385 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4b0a400d-59c2-459d-8f2c-ac39870c8973-secret-metrics-server-client-certs\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.743648 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.743422 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0a400d-59c2-459d-8f2c-ac39870c8973-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.844242 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.844162 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4b0a400d-59c2-459d-8f2c-ac39870c8973-audit-log\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.844242 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.844209 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4b0a400d-59c2-459d-8f2c-ac39870c8973-metrics-server-audit-profiles\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.844242 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.844240 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b0a400d-59c2-459d-8f2c-ac39870c8973-client-ca-bundle\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.844518 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.844272 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4b0a400d-59c2-459d-8f2c-ac39870c8973-secret-metrics-server-client-certs\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.844518 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.844299 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0a400d-59c2-459d-8f2c-ac39870c8973-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.844518 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.844333 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4b0a400d-59c2-459d-8f2c-ac39870c8973-secret-metrics-server-tls\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.844873 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.844845 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4b0a400d-59c2-459d-8f2c-ac39870c8973-audit-log\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.845029 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.844405 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9nc2\" (UniqueName: \"kubernetes.io/projected/4b0a400d-59c2-459d-8f2c-ac39870c8973-kube-api-access-x9nc2\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.845813 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.845789 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4b0a400d-59c2-459d-8f2c-ac39870c8973-metrics-server-audit-profiles\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.846391 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.846368 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0a400d-59c2-459d-8f2c-ac39870c8973-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.848114 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.848087 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4b0a400d-59c2-459d-8f2c-ac39870c8973-secret-metrics-server-client-certs\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.848656 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.848614 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b0a400d-59c2-459d-8f2c-ac39870c8973-client-ca-bundle\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.849060 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.849038 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4b0a400d-59c2-459d-8f2c-ac39870c8973-secret-metrics-server-tls\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.873942 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.873920 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9nc2\" (UniqueName: \"kubernetes.io/projected/4b0a400d-59c2-459d-8f2c-ac39870c8973-kube-api-access-x9nc2\") pod \"metrics-server-6687598896-72zcj\" (UID: \"4b0a400d-59c2-459d-8f2c-ac39870c8973\") " pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.884283 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:37:53.884237 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:37:53.898604 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.898579 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:37:53.904958 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.904935 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-567fb4f6d5-wmspl"] Oct 30 18:37:53.910824 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.910801 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:53.932549 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.932521 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567fb4f6d5-wmspl"] Oct 30 18:37:53.933260 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.932583 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 18:37:53.933407 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.932749 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 18:37:53.933407 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.932878 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 18:37:53.934246 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.934216 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 18:37:53.939996 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.934267 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 18:37:53.939996 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.934756 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gdpsg\"" Oct 30 18:37:53.958823 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:53.958751 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 18:37:54.047065 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.047035 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-serving-cert\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.047244 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.047089 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-trusted-ca-bundle\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.047244 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.047119 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-service-ca\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.047244 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.047154 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-config\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.047244 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.047189 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-oauth-config\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.047244 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.047211 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6152ff40-5cd6-4f97-bd09-4aaf06039cce-tmp\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.047244 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.047235 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-oauth-serving-cert\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.047555 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.047263 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb7dh\" (UniqueName: \"kubernetes.io/projected/6152ff40-5cd6-4f97-bd09-4aaf06039cce-kube-api-access-vb7dh\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.148406 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.148321 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-trusted-ca-bundle\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.148406 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.148384 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-service-ca\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.148638 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.148427 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-config\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.148638 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.148507 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-oauth-config\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.148638 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.148530 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6152ff40-5cd6-4f97-bd09-4aaf06039cce-tmp\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.148638 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.148569 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-oauth-serving-cert\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.148638 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.148614 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb7dh\" (UniqueName: \"kubernetes.io/projected/6152ff40-5cd6-4f97-bd09-4aaf06039cce-kube-api-access-vb7dh\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.148869 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.148750 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-serving-cert\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.149598 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.149577 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-service-ca\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.149682 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.149656 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-oauth-serving-cert\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.149854 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.149835 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-trusted-ca-bundle\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.150024 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.150006 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-config\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.150238 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.150222 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6152ff40-5cd6-4f97-bd09-4aaf06039cce-tmp\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.152959 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.152938 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-oauth-config\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.153063 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.153021 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-serving-cert\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.171405 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.171358 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb7dh\" (UniqueName: \"kubernetes.io/projected/6152ff40-5cd6-4f97-bd09-4aaf06039cce-kube-api-access-vb7dh\") pod \"console-567fb4f6d5-wmspl\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.230548 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.230520 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6687598896-72zcj"] Oct 30 18:37:54.239364 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:54.239336 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0a400d_59c2_459d_8f2c_ac39870c8973.slice/crio-1d16222bff10cb65f859140a4ada253424ca6dbd0924f4f230df148c8ec31b07 WatchSource:0}: Error finding container 1d16222bff10cb65f859140a4ada253424ca6dbd0924f4f230df148c8ec31b07: Status 404 returned error can't find the container with id 1d16222bff10cb65f859140a4ada253424ca6dbd0924f4f230df148c8ec31b07 Oct 30 18:37:54.241238 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.241205 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:37:54.366889 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.366860 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-675b496b4d-xpc6k"] Oct 30 18:37:54.370435 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.370416 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.388248 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.388204 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Oct 30 18:37:54.389123 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.389093 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Oct 30 18:37:54.397036 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.397012 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-675b496b4d-xpc6k"] Oct 30 18:37:54.424335 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.424312 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Oct 30 18:37:54.424438 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.424392 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Oct 30 18:37:54.424660 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.424634 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Oct 30 18:37:54.424660 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.424657 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8d2z8\"" Oct 30 18:37:54.424793 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.424730 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Oct 30 18:37:54.549626 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.549591 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567fb4f6d5-wmspl"] Oct 30 18:37:54.552815 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.552785 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-federate-client-tls\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.552960 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.552839 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck4f5\" (UniqueName: \"kubernetes.io/projected/9bba22e6-bc42-4761-85de-dff0a7b5596c-kube-api-access-ck4f5\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.552960 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.552940 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-secret-telemeter-client\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.553086 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.552977 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-telemeter-client-tls\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.553086 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.553035 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bba22e6-bc42-4761-85de-dff0a7b5596c-metrics-client-ca\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.553086 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.553076 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bba22e6-bc42-4761-85de-dff0a7b5596c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.553243 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.553111 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.553243 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.553140 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bba22e6-bc42-4761-85de-dff0a7b5596c-serving-certs-ca-bundle\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.553782 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:37:54.553752 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6152ff40_5cd6_4f97_bd09_4aaf06039cce.slice/crio-db4f17fee6e801922e51c7cf22258263ca9a06ed9e1311a2a0eaaf4b0b9bb871 WatchSource:0}: Error finding container db4f17fee6e801922e51c7cf22258263ca9a06ed9e1311a2a0eaaf4b0b9bb871: Status 404 returned error can't find the container with id db4f17fee6e801922e51c7cf22258263ca9a06ed9e1311a2a0eaaf4b0b9bb871 Oct 30 18:37:54.654544 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.654467 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.654544 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.654517 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bba22e6-bc42-4761-85de-dff0a7b5596c-serving-certs-ca-bundle\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.654756 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.654550 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-federate-client-tls\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.654756 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.654575 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck4f5\" (UniqueName: \"kubernetes.io/projected/9bba22e6-bc42-4761-85de-dff0a7b5596c-kube-api-access-ck4f5\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.654756 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.654632 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-secret-telemeter-client\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.654756 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.654655 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-telemeter-client-tls\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.654756 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.654717 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bba22e6-bc42-4761-85de-dff0a7b5596c-metrics-client-ca\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.654756 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.654754 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bba22e6-bc42-4761-85de-dff0a7b5596c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.655794 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.655737 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bba22e6-bc42-4761-85de-dff0a7b5596c-metrics-client-ca\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.655794 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.655772 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bba22e6-bc42-4761-85de-dff0a7b5596c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.655794 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.655775 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bba22e6-bc42-4761-85de-dff0a7b5596c-serving-certs-ca-bundle\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.657654 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.657629 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-secret-telemeter-client\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.657782 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.657636 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.657851 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.657821 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-telemeter-client-tls\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.659328 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.659305 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9bba22e6-bc42-4761-85de-dff0a7b5596c-federate-client-tls\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.678602 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.678577 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck4f5\" (UniqueName: \"kubernetes.io/projected/9bba22e6-bc42-4761-85de-dff0a7b5596c-kube-api-access-ck4f5\") pod \"telemeter-client-675b496b4d-xpc6k\" (UID: \"9bba22e6-bc42-4761-85de-dff0a7b5596c\") " pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.691383 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.691343 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" Oct 30 18:37:54.976106 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.976070 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" event={"ID":"a6b7a2de-aadb-42b6-ae13-77588a054e3e","Type":"ContainerStarted","Data":"819f1988fb250cb7ed0961631582ecdc8e043345608c11bc68c4b1bfb20e66cc"} Oct 30 18:37:54.976520 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.976151 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" event={"ID":"a6b7a2de-aadb-42b6-ae13-77588a054e3e","Type":"ContainerStarted","Data":"011009134c82f6a24802f50a94a1a3d3726d365db709bccf85d257fe29c16760"} Oct 30 18:37:54.976520 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.976193 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" event={"ID":"a6b7a2de-aadb-42b6-ae13-77588a054e3e","Type":"ContainerStarted","Data":"26a557402af248f2edc226768671cd125a031a83933dda8f7354c1ed1785fc4d"} Oct 30 18:37:54.977554 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.977527 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567fb4f6d5-wmspl" event={"ID":"6152ff40-5cd6-4f97-bd09-4aaf06039cce","Type":"ContainerStarted","Data":"db4f17fee6e801922e51c7cf22258263ca9a06ed9e1311a2a0eaaf4b0b9bb871"} Oct 30 18:37:54.978969 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:54.978939 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6687598896-72zcj" event={"ID":"4b0a400d-59c2-459d-8f2c-ac39870c8973","Type":"ContainerStarted","Data":"1d16222bff10cb65f859140a4ada253424ca6dbd0924f4f230df148c8ec31b07"} Oct 30 18:37:55.040214 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:55.040179 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-675b496b4d-xpc6k"] Oct 30 18:37:55.998026 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:55.997972 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" event={"ID":"a6b7a2de-aadb-42b6-ae13-77588a054e3e","Type":"ContainerStarted","Data":"3c236c1c2fb92205b84ad29f0ecf995251029a4a3d8966c982e898ffb6e185e0"} Oct 30 18:37:55.998478 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:55.998071 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" event={"ID":"a6b7a2de-aadb-42b6-ae13-77588a054e3e","Type":"ContainerStarted","Data":"b7489b59c408a6855969fb71f7d8aa713f4de29294f80af2abad601451f16282"} Oct 30 18:37:55.998478 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:55.998114 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" event={"ID":"a6b7a2de-aadb-42b6-ae13-77588a054e3e","Type":"ContainerStarted","Data":"471615a1996fb880cfa20691692f475ad0d5766ef6ac34d798abd57277728161"} Oct 30 18:37:55.999094 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:55.999064 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:37:56.000652 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:56.000617 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" event={"ID":"9bba22e6-bc42-4761-85de-dff0a7b5596c","Type":"ContainerStarted","Data":"14e726bade569add38a3af23277579708ba319cd2f67b6d3df0323e4e46e4990"} Oct 30 18:37:56.065677 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:56.065617 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" podStartSLOduration=2.156985618 podStartE2EDuration="5.065603719s" totalImagesPullingTime="2.908618101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:56.051472972 +0000 UTC m=+38.414486338" watchObservedRunningTime="2026-10-30 18:37:56.065603719 +0000 UTC m=+38.428617085" Oct 30 18:37:56.545689 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:56.545600 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567fb4f6d5-wmspl"] Oct 30 18:37:57.010148 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:57.010112 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6687598896-72zcj" event={"ID":"4b0a400d-59c2-459d-8f2c-ac39870c8973","Type":"ContainerStarted","Data":"40ce3ebff30d2b4b75272d769fc4a924ff39b245faecf013097e5c2335074588"} Oct 30 18:37:57.058794 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:57.058728 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6687598896-72zcj" podStartSLOduration=2.270132517 podStartE2EDuration="4.058708756s" totalImagesPullingTime="1.788576239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:57.05838313 +0000 UTC m=+39.421396511" watchObservedRunningTime="2026-10-30 18:37:57.058708756 +0000 UTC m=+39.421722123" Oct 30 18:37:58.015537 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:58.015490 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" event={"ID":"9bba22e6-bc42-4761-85de-dff0a7b5596c","Type":"ContainerStarted","Data":"6f5fb5f601871cbdb82d7412a9f5d39420e37c564263068c2a465accf6a25963"} Oct 30 18:37:59.022286 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:59.022249 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567fb4f6d5-wmspl" event={"ID":"6152ff40-5cd6-4f97-bd09-4aaf06039cce","Type":"ContainerStarted","Data":"31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d"} Oct 30 18:37:59.024840 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:59.024806 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" event={"ID":"9bba22e6-bc42-4761-85de-dff0a7b5596c","Type":"ContainerStarted","Data":"fac8a9cbec65e48580fce473db3bf4b91f9c4a741f5d059e6b26508ef52d8f10"} Oct 30 18:37:59.025001 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:59.024867 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" event={"ID":"9bba22e6-bc42-4761-85de-dff0a7b5596c","Type":"ContainerStarted","Data":"47dce2903a27a6ed2254c665fe47aeda457163753b05e052eac37f421892477c"} Oct 30 18:37:59.067873 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:59.067813 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-567fb4f6d5-wmspl" podStartSLOduration=2.51193363 podStartE2EDuration="6.067799227s" totalImagesPullingTime="3.555865597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:59.066399693 +0000 UTC m=+41.429413059" watchObservedRunningTime="2026-10-30 18:37:59.067799227 +0000 UTC m=+41.430812594" Oct 30 18:37:59.114188 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:37:59.114132 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-675b496b4d-xpc6k" podStartSLOduration=2.021086752 podStartE2EDuration="5.114114728s" totalImagesPullingTime="3.093027976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:59.113273427 +0000 UTC m=+41.476286794" watchObservedRunningTime="2026-10-30 18:37:59.114114728 +0000 UTC m=+41.477128096" Oct 30 18:38:00.032472 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:00.032429 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-nnv76" event={"ID":"0b87df89-bda3-4bfb-8d51-b143ab8fd67e","Type":"ContainerStarted","Data":"304b21a363f24417da78ef4473171c157616fe56aa9dc7bc93d03f5956543dd3"} Oct 30 18:38:00.032928 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:00.032722 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-nnv76" Oct 30 18:38:00.050023 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:00.049997 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-nnv76" Oct 30 18:38:00.090275 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:00.090161 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-nnv76" podStartSLOduration=1.616609264 podStartE2EDuration="19.09014372s" totalImagesPullingTime="17.473534456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:00.089211718 +0000 UTC m=+42.452225086" watchObservedRunningTime="2026-10-30 18:38:00.09014372 +0000 UTC m=+42.453157088" Oct 30 18:38:03.022925 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:03.022824 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7df7867bcc-pjv7q" Oct 30 18:38:04.241596 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:04.241550 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:38:13.899322 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:13.899292 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:38:13.899736 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:13.899344 4392 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:38:21.966759 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:21.966721 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:38:22.032739 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.032696 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:38:22.032941 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.032876 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.051865 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.051844 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 18:38:22.052090 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.052074 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bwcmn\"" Oct 30 18:38:22.052153 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.052143 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 18:38:22.052194 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.052151 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 18:38:22.052451 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.052440 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 18:38:22.052725 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.052705 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 18:38:22.065299 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.065276 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 18:38:22.065299 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.065295 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 18:38:22.065419 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.065345 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 18:38:22.079757 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.079741 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 18:38:22.101853 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.101834 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-out\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.101968 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.101863 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.101968 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.101882 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.101968 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.101920 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.102069 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.101983 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-web-config\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.102145 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.102128 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.102178 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.102159 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.102237 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.102223 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.102269 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.102252 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.102342 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.102331 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45bfk\" (UniqueName: \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-kube-api-access-45bfk\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.102374 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.102355 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-volume\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.102405 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.102388 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.102456 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.102441 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.131227 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.131203 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 18:38:22.134561 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.134543 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.153252 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.153227 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Oct 30 18:38:22.153535 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.153521 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Oct 30 18:38:22.153587 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.153527 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Oct 30 18:38:22.153587 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.153553 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-snpb4\"" Oct 30 18:38:22.153694 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.153680 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7265990njcmgq\"" Oct 30 18:38:22.153745 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.153701 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Oct 30 18:38:22.153745 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.153709 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Oct 30 18:38:22.153815 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.153745 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Oct 30 18:38:22.154878 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.154836 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Oct 30 18:38:22.154992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.154883 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Oct 30 18:38:22.154992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.154938 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Oct 30 18:38:22.154992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.154947 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Oct 30 18:38:22.154992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.154942 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Oct 30 18:38:22.167158 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.167141 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Oct 30 18:38:22.167256 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.167211 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Oct 30 18:38:22.170524 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.170494 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Oct 30 18:38:22.171933 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.171896 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 18:38:22.202854 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.202833 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.203021 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.202868 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.203021 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.202885 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcsrp\" (UniqueName: \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-kube-api-access-dcsrp\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.203021 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.202929 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-out\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.203021 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.202998 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203119 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203153 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203173 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203199 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203265 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203294 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-web-config\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203331 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203355 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203387 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203411 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203432 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203466 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203488 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203536 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203561 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.203871 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.203585 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.204992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.204403 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.204992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.204799 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.204992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.204866 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.204992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.204889 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.204992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.204943 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.204992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.204961 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.205298 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.205011 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45bfk\" (UniqueName: \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-kube-api-access-45bfk\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.205298 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.205029 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.205298 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.205258 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-volume\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.205298 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.205279 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.205491 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.205379 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.205707 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.205669 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.205864 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.205846 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.206021 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.205894 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.206021 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.205935 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.206695 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.206668 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.208081 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.207815 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-volume\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.208081 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.207992 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.208081 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.208049 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-out\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.208336 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.208313 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.208928 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.208886 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.209034 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.208974 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.209034 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.209019 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.209151 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.209142 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-web-config\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.232664 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.232604 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45bfk\" (UniqueName: \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-kube-api-access-45bfk\") pod \"alertmanager-main-0\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.306759 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.306732 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.306759 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.306761 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307084 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.306776 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307084 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.306804 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307084 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.306820 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307084 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.306834 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307084 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.306858 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307299 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307246 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307397 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307368 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307480 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307417 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307480 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307449 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307595 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307476 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307595 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307511 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307595 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307546 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307595 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307582 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307800 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307607 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307800 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307644 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307800 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307657 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307800 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307681 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcsrp\" (UniqueName: \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-kube-api-access-dcsrp\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307800 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307716 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307800 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307752 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.307800 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.307791 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.308184 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.308123 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.309043 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.308693 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.309441 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.309255 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.311947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.309769 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.311947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.310092 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.311947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.310312 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.311947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.310603 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.311947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.310863 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.311947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.311134 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.311947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.311529 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.312333 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.312057 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.312333 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.312091 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.312333 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.312310 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.312509 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.312490 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.312554 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.312514 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.312979 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.312954 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.313268 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.313252 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.339314 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.339294 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcsrp\" (UniqueName: \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-kube-api-access-dcsrp\") pod \"prometheus-k8s-0\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.377671 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.377639 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:38:22.457588 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.457562 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:22.721086 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.721056 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:38:22.726482 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:38:22.726458 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf4eb9f_1612_4e69_ae23_9d6fd959c66c.slice/crio-410d08a3f0b96026dd8f1b4d031da63c6669917f674c9954e4bec3efebec141c WatchSource:0}: Error finding container 410d08a3f0b96026dd8f1b4d031da63c6669917f674c9954e4bec3efebec141c: Status 404 returned error can't find the container with id 410d08a3f0b96026dd8f1b4d031da63c6669917f674c9954e4bec3efebec141c Oct 30 18:38:22.772787 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:22.772746 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 18:38:22.776234 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:38:22.776205 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76d2acf_2e68_4c79_9a22_0a49ef77928b.slice/crio-67c2893118694cb9c720850ca149ac24dffa569ad1d051918e0878614954b7c5 WatchSource:0}: Error finding container 67c2893118694cb9c720850ca149ac24dffa569ad1d051918e0878614954b7c5: Status 404 returned error can't find the container with id 67c2893118694cb9c720850ca149ac24dffa569ad1d051918e0878614954b7c5 Oct 30 18:38:23.121116 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:23.121040 4392 generic.go:356] "Generic (PLEG): container finished" podID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerID="ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b" exitCode=0 Oct 30 18:38:23.121525 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:23.121123 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerDied","Data":"ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b"} Oct 30 18:38:23.121525 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:23.121205 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerStarted","Data":"410d08a3f0b96026dd8f1b4d031da63c6669917f674c9954e4bec3efebec141c"} Oct 30 18:38:23.122760 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:23.122737 4392 generic.go:356] "Generic (PLEG): container finished" podID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerID="f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a" exitCode=0 Oct 30 18:38:23.122859 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:23.122803 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerDied","Data":"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a"} Oct 30 18:38:23.122939 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:23.122872 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerStarted","Data":"67c2893118694cb9c720850ca149ac24dffa569ad1d051918e0878614954b7c5"} Oct 30 18:38:23.880223 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:38:23.880184 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:38:24.043162 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.043120 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-567fb4f6d5-wmspl" podUID="6152ff40-5cd6-4f97-bd09-4aaf06039cce" containerName="console" containerID="cri-o://31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d" gracePeriod=15 Oct 30 18:38:24.314621 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.314569 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:38:24.428650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.428516 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6152ff40-5cd6-4f97-bd09-4aaf06039cce-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6152ff40-5cd6-4f97-bd09-4aaf06039cce-tmp\") pod \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " Oct 30 18:38:24.428650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.428585 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-service-ca\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-service-ca\") pod \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " Oct 30 18:38:24.428650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.428622 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-config\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-config\") pod \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " Oct 30 18:38:24.428995 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.428689 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-serving-cert\") pod \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " Oct 30 18:38:24.428995 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.428715 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-trusted-ca-bundle\") pod \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " Oct 30 18:38:24.428995 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.428753 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-oauth-serving-cert\") pod \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " Oct 30 18:38:24.428995 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.428786 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6152ff40-5cd6-4f97-bd09-4aaf06039cce-kube-api-access-vb7dh\" (UniqueName: \"kubernetes.io/projected/6152ff40-5cd6-4f97-bd09-4aaf06039cce-kube-api-access-vb7dh\") pod \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " Oct 30 18:38:24.428995 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.428810 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-oauth-config\") pod \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\" (UID: \"6152ff40-5cd6-4f97-bd09-4aaf06039cce\") " Oct 30 18:38:24.429857 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.429625 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6152ff40-5cd6-4f97-bd09-4aaf06039cce-tmp" pod "6152ff40-5cd6-4f97-bd09-4aaf06039cce" (UID: "6152ff40-5cd6-4f97-bd09-4aaf06039cce"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:38:24.429857 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.429664 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-trusted-ca-bundle" pod "6152ff40-5cd6-4f97-bd09-4aaf06039cce" (UID: "6152ff40-5cd6-4f97-bd09-4aaf06039cce"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:38:24.429857 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.429732 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-service-ca" pod "6152ff40-5cd6-4f97-bd09-4aaf06039cce" (UID: "6152ff40-5cd6-4f97-bd09-4aaf06039cce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:38:24.429857 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.429759 4392 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6152ff40-5cd6-4f97-bd09-4aaf06039cce-tmp\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:38:24.429857 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.429785 4392 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-trusted-ca-bundle\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:38:24.429857 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.429814 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-oauth-serving-cert" pod "6152ff40-5cd6-4f97-bd09-4aaf06039cce" (UID: "6152ff40-5cd6-4f97-bd09-4aaf06039cce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:38:24.429857 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.429833 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-config" pod "6152ff40-5cd6-4f97-bd09-4aaf06039cce" (UID: "6152ff40-5cd6-4f97-bd09-4aaf06039cce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:38:24.431846 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.431821 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-serving-cert" pod "6152ff40-5cd6-4f97-bd09-4aaf06039cce" (UID: "6152ff40-5cd6-4f97-bd09-4aaf06039cce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:38:24.432345 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.432320 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6152ff40-5cd6-4f97-bd09-4aaf06039cce-kube-api-access-vb7dh" pod "6152ff40-5cd6-4f97-bd09-4aaf06039cce" (UID: "6152ff40-5cd6-4f97-bd09-4aaf06039cce"). InnerVolumeSpecName "kube-api-access-vb7dh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:38:24.445481 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.445452 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-oauth-config" pod "6152ff40-5cd6-4f97-bd09-4aaf06039cce" (UID: "6152ff40-5cd6-4f97-bd09-4aaf06039cce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:38:24.531057 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.531026 4392 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-service-ca\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:38:24.531057 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.531057 4392 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:38:24.531057 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.531067 4392 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-serving-cert\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:38:24.531300 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.531076 4392 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6152ff40-5cd6-4f97-bd09-4aaf06039cce-oauth-serving-cert\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:38:24.531300 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.531085 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb7dh\" (UniqueName: \"kubernetes.io/projected/6152ff40-5cd6-4f97-bd09-4aaf06039cce-kube-api-access-vb7dh\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:38:24.531300 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:24.531095 4392 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6152ff40-5cd6-4f97-bd09-4aaf06039cce-console-oauth-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:38:25.137964 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.137932 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerStarted","Data":"dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca"} Oct 30 18:38:25.138074 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.138029 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerStarted","Data":"5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c"} Oct 30 18:38:25.138074 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.138055 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerStarted","Data":"12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975"} Oct 30 18:38:25.138188 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.138078 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerStarted","Data":"acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb"} Oct 30 18:38:25.138188 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.138101 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerStarted","Data":"5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d"} Oct 30 18:38:25.139485 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.139461 4392 generic.go:356] "Generic (PLEG): container finished" podID="6152ff40-5cd6-4f97-bd09-4aaf06039cce" containerID="31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d" exitCode=0 Oct 30 18:38:25.139582 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.139519 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567fb4f6d5-wmspl" event={"ID":"6152ff40-5cd6-4f97-bd09-4aaf06039cce","Type":"ContainerDied","Data":"31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d"} Oct 30 18:38:25.139582 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.139548 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567fb4f6d5-wmspl" event={"ID":"6152ff40-5cd6-4f97-bd09-4aaf06039cce","Type":"ContainerDied","Data":"db4f17fee6e801922e51c7cf22258263ca9a06ed9e1311a2a0eaaf4b0b9bb871"} Oct 30 18:38:25.139582 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.139566 4392 scope.go:122] "RemoveContainer" containerID="31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d" Oct 30 18:38:25.139705 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.139691 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567fb4f6d5-wmspl" Oct 30 18:38:25.158434 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.158413 4392 scope.go:122] "RemoveContainer" containerID="31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d" Oct 30 18:38:25.158736 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:38:25.158713 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d\": container with ID starting with 31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d not found: ID does not exist" containerID="31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d" Oct 30 18:38:25.158812 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.158745 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d"} err="failed to get container status \"31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d\": rpc error: code = NotFound desc = could not find container \"31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d\": container with ID starting with 31366b17e41d02675121822e4909e5d7ccbaa13430ae6403c464d531afc6ca8d not found: ID does not exist" Oct 30 18:38:25.195130 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.195107 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567fb4f6d5-wmspl"] Oct 30 18:38:25.208647 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.208625 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-567fb4f6d5-wmspl"] Oct 30 18:38:25.786727 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:25.786688 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6152ff40-5cd6-4f97-bd09-4aaf06039cce" path="/var/lib/kubelet/pods/6152ff40-5cd6-4f97-bd09-4aaf06039cce/volumes" Oct 30 18:38:26.147707 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:26.147615 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerStarted","Data":"b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab"} Oct 30 18:38:26.242347 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:26.242293 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.729282866 podStartE2EDuration="5.242278657s" totalImagesPullingTime="1.496427019s" totalInitContainerRuntime="16.568772ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:26.228500409 +0000 UTC m=+68.591513773" watchObservedRunningTime="2026-10-30 18:38:26.242278657 +0000 UTC m=+68.605292021" Oct 30 18:38:27.155811 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:27.155777 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerStarted","Data":"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80"} Oct 30 18:38:27.156178 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:27.155844 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerStarted","Data":"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59"} Oct 30 18:38:27.156178 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:27.155869 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerStarted","Data":"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726"} Oct 30 18:38:27.156178 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:27.155893 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerStarted","Data":"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104"} Oct 30 18:38:27.156178 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:27.155941 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerStarted","Data":"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c"} Oct 30 18:38:27.156178 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:27.155966 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerStarted","Data":"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b"} Oct 30 18:38:27.214545 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:27.214464 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.906994574 podStartE2EDuration="5.21444954s" totalImagesPullingTime="3.291473225s" totalInitContainerRuntime="15.981741ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:27.21324018 +0000 UTC m=+69.576253544" watchObservedRunningTime="2026-10-30 18:38:27.21444954 +0000 UTC m=+69.577462907" Oct 30 18:38:27.458629 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:27.458600 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:38:33.904417 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:33.904391 4392 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:38:33.908112 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:38:33.908089 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6687598896-72zcj" Oct 30 18:38:53.873986 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:38:53.873949 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:39:22.457815 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:22.457774 4392 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:22.475693 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:22.475669 4392 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:23.408950 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:23.408921 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:23.873603 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:23.873565 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:39:30.954664 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:30.954582 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:39:30.955180 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:30.954887 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="alertmanager" containerID="cri-o://5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d" gracePeriod=120 Oct 30 18:39:30.955180 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:30.954969 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy-metric" containerID="cri-o://dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca" gracePeriod=120 Oct 30 18:39:30.955180 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:30.955011 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="prom-label-proxy" containerID="cri-o://b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab" gracePeriod=120 Oct 30 18:39:30.955180 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:30.955030 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy-web" containerID="cri-o://12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975" gracePeriod=120 Oct 30 18:39:30.955180 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:30.955049 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy" containerID="cri-o://5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c" gracePeriod=120 Oct 30 18:39:30.955180 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:30.955061 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="config-reloader" containerID="cri-o://acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb" gracePeriod=120 Oct 30 18:39:31.423985 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:31.423957 4392 generic.go:356] "Generic (PLEG): container finished" podID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerID="b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab" exitCode=0 Oct 30 18:39:31.423985 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:31.423981 4392 generic.go:356] "Generic (PLEG): container finished" podID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerID="dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca" exitCode=0 Oct 30 18:39:31.423985 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:31.423987 4392 generic.go:356] "Generic (PLEG): container finished" podID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerID="5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c" exitCode=0 Oct 30 18:39:31.424213 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:31.423994 4392 generic.go:356] "Generic (PLEG): container finished" podID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerID="acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb" exitCode=0 Oct 30 18:39:31.424213 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:31.423999 4392 generic.go:356] "Generic (PLEG): container finished" podID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerID="5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d" exitCode=0 Oct 30 18:39:31.424213 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:31.424030 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerDied","Data":"b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab"} Oct 30 18:39:31.424213 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:31.424091 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerDied","Data":"dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca"} Oct 30 18:39:31.424213 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:31.424117 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerDied","Data":"5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c"} Oct 30 18:39:31.424213 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:31.424139 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerDied","Data":"acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb"} Oct 30 18:39:31.424213 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:31.424160 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerDied","Data":"5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d"} Oct 30 18:39:32.203796 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.203775 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.307672 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307597 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-trusted-ca-bundle\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.307672 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307645 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-kube-api-access-45bfk\" (UniqueName: \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-kube-api-access-45bfk\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.307883 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307680 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.307883 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307715 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.307883 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307741 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-main-tls\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.307883 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307778 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-tls-assets\" (UniqueName: \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-tls-assets\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.307883 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307820 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-out\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.307883 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307860 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-web-config\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-web-config\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.308188 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307887 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-cluster-tls-config\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.308188 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307953 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-metrics-client-ca\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.308188 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.307996 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-web\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.308188 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.308024 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-main-db\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.308188 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.308061 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-volume\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-volume\") pod \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\" (UID: \"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c\") " Oct 30 18:39:32.310136 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.309370 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-main-db" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:39:32.310136 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.309629 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-metrics-client-ca" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:32.310136 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.309833 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-trusted-ca-bundle" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:32.311455 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.311428 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-volume" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:32.312672 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.312643 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-web" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:32.314109 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.314014 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-tls-assets" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:39:32.314109 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.314053 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-kube-api-access-45bfk" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "kube-api-access-45bfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:39:32.314109 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.314071 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-main-tls" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:32.314341 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.314119 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:32.314461 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.314431 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-metric" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:32.315802 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.315711 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-out" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:39:32.317864 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.317837 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-cluster-tls-config" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:32.330414 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.330378 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-web-config" pod "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" (UID: "4cf4eb9f-1612-4e69-ae23-9d6fd959c66c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:32.409519 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409486 4392 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409519 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409514 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45bfk\" (UniqueName: \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-kube-api-access-45bfk\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409519 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409525 4392 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409723 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409534 4392 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409723 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409545 4392 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-main-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409723 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409554 4392 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-tls-assets\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409723 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409561 4392 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-out\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409723 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409570 4392 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-web-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409723 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409578 4392 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-cluster-tls-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409723 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409586 4392 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-metrics-client-ca\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409723 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409596 4392 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409723 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409604 4392 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-alertmanager-main-db\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.409723 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.409612 4392 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c-config-volume\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:32.430947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.430894 4392 generic.go:356] "Generic (PLEG): container finished" podID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerID="12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975" exitCode=0 Oct 30 18:39:32.430947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.430935 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerDied","Data":"12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975"} Oct 30 18:39:32.431131 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.430980 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.431131 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.431007 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cf4eb9f-1612-4e69-ae23-9d6fd959c66c","Type":"ContainerDied","Data":"410d08a3f0b96026dd8f1b4d031da63c6669917f674c9954e4bec3efebec141c"} Oct 30 18:39:32.431131 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.431041 4392 scope.go:122] "RemoveContainer" containerID="b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab" Oct 30 18:39:32.439481 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.439341 4392 scope.go:122] "RemoveContainer" containerID="dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca" Oct 30 18:39:32.446403 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.446383 4392 scope.go:122] "RemoveContainer" containerID="5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c" Oct 30 18:39:32.452872 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.452854 4392 scope.go:122] "RemoveContainer" containerID="12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975" Oct 30 18:39:32.459307 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.459290 4392 scope.go:122] "RemoveContainer" containerID="acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb" Oct 30 18:39:32.467425 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.467408 4392 scope.go:122] "RemoveContainer" containerID="5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d" Oct 30 18:39:32.474423 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.474402 4392 scope.go:122] "RemoveContainer" containerID="ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b" Oct 30 18:39:32.481058 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.481042 4392 scope.go:122] "RemoveContainer" containerID="b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab" Oct 30 18:39:32.481293 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:32.481274 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab\": container with ID starting with b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab not found: ID does not exist" containerID="b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab" Oct 30 18:39:32.481364 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.481306 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab"} err="failed to get container status \"b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab\": rpc error: code = NotFound desc = could not find container \"b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab\": container with ID starting with b83aebdfb6c69cefa2f18399f7e177825ba3d49fd14e1394b7a9b82c44af1eab not found: ID does not exist" Oct 30 18:39:32.481364 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.481330 4392 scope.go:122] "RemoveContainer" containerID="dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca" Oct 30 18:39:32.481617 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:32.481600 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca\": container with ID starting with dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca not found: ID does not exist" containerID="dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca" Oct 30 18:39:32.481652 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.481627 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca"} err="failed to get container status \"dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca\": rpc error: code = NotFound desc = could not find container \"dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca\": container with ID starting with dbb9cf7d9a35f13d4b64b13c8c0df62fac850336c2743abd99847957d5bf34ca not found: ID does not exist" Oct 30 18:39:32.481652 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.481643 4392 scope.go:122] "RemoveContainer" containerID="5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c" Oct 30 18:39:32.481868 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:32.481852 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c\": container with ID starting with 5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c not found: ID does not exist" containerID="5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c" Oct 30 18:39:32.481954 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.481877 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c"} err="failed to get container status \"5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c\": rpc error: code = NotFound desc = could not find container \"5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c\": container with ID starting with 5ad4429941d6e0b2e3fd0110d66c5e961d1d643ff053c6047e2a5559bea52e6c not found: ID does not exist" Oct 30 18:39:32.481954 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.481897 4392 scope.go:122] "RemoveContainer" containerID="12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975" Oct 30 18:39:32.482169 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:32.482153 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975\": container with ID starting with 12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975 not found: ID does not exist" containerID="12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975" Oct 30 18:39:32.482206 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.482174 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975"} err="failed to get container status \"12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975\": rpc error: code = NotFound desc = could not find container \"12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975\": container with ID starting with 12b7928c83a89552527a3b807881b839d850c2b526e3c352caaa343d7683d975 not found: ID does not exist" Oct 30 18:39:32.482206 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.482188 4392 scope.go:122] "RemoveContainer" containerID="acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb" Oct 30 18:39:32.482383 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:32.482368 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb\": container with ID starting with acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb not found: ID does not exist" containerID="acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb" Oct 30 18:39:32.482426 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.482385 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb"} err="failed to get container status \"acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb\": rpc error: code = NotFound desc = could not find container \"acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb\": container with ID starting with acb6cdbaf172f45ae736788205b3e7cb27c4a8ec5bdfdee2c087cb6a819cd1bb not found: ID does not exist" Oct 30 18:39:32.482426 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.482398 4392 scope.go:122] "RemoveContainer" containerID="5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d" Oct 30 18:39:32.482605 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:32.482590 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d\": container with ID starting with 5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d not found: ID does not exist" containerID="5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d" Oct 30 18:39:32.482638 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.482610 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d"} err="failed to get container status \"5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d\": rpc error: code = NotFound desc = could not find container \"5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d\": container with ID starting with 5545ad44658aa794d2773036531a86ac5be4fa9c70ff3229720fa7dfbdaac99d not found: ID does not exist" Oct 30 18:39:32.482638 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.482624 4392 scope.go:122] "RemoveContainer" containerID="ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b" Oct 30 18:39:32.482845 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:32.482828 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b\": container with ID starting with ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b not found: ID does not exist" containerID="ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b" Oct 30 18:39:32.482901 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.482852 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b"} err="failed to get container status \"ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b\": rpc error: code = NotFound desc = could not find container \"ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b\": container with ID starting with ab17a6c289173b6be3496c13ea31684ea99cd2187061ffbc2fb7853eb7afce3b not found: ID does not exist" Oct 30 18:39:32.490370 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.490350 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:39:32.498742 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.498725 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:39:32.531872 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.531850 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:39:32.532167 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532155 4392 cpu_manager.go:414] "containerMap: removing container" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="config-reloader" Oct 30 18:39:32.532214 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532169 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="config-reloader" Oct 30 18:39:32.532214 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532186 4392 cpu_manager.go:414] "containerMap: removing container" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy" Oct 30 18:39:32.532214 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532192 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy" Oct 30 18:39:32.532214 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532203 4392 cpu_manager.go:414] "containerMap: removing container" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="init-config-reloader" Oct 30 18:39:32.532214 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532208 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="init-config-reloader" Oct 30 18:39:32.532214 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532214 4392 cpu_manager.go:414] "containerMap: removing container" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy-metric" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532219 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy-metric" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532230 4392 cpu_manager.go:414] "containerMap: removing container" podUID="6152ff40-5cd6-4f97-bd09-4aaf06039cce" containerName="console" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532234 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6152ff40-5cd6-4f97-bd09-4aaf06039cce" containerName="console" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532244 4392 cpu_manager.go:414] "containerMap: removing container" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy-web" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532249 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy-web" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532255 4392 cpu_manager.go:414] "containerMap: removing container" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="prom-label-proxy" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532260 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="prom-label-proxy" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532268 4392 cpu_manager.go:414] "containerMap: removing container" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="alertmanager" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532273 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="alertmanager" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532314 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="alertmanager" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532323 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="config-reloader" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532330 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532337 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy-metric" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532343 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="6152ff40-5cd6-4f97-bd09-4aaf06039cce" containerName="console" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532349 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="kube-rbac-proxy-web" Oct 30 18:39:32.532412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.532354 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" containerName="prom-label-proxy" Oct 30 18:39:32.537331 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.537315 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.554740 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.554711 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 18:39:32.554850 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.554833 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 18:39:32.554929 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.554858 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 18:39:32.554929 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.554871 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 18:39:32.554929 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.554887 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 18:39:32.555048 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.555012 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 18:39:32.555048 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.555044 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 18:39:32.555162 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.555148 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bwcmn\"" Oct 30 18:39:32.555196 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.555186 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 18:39:32.567998 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.567947 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 18:39:32.569877 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.569858 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:39:32.712396 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712358 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.712396 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712395 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.712677 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712425 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db78bd40-823a-42eb-9814-4c6372e1d872-config-out\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.712677 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712572 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db78bd40-823a-42eb-9814-4c6372e1d872-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.712677 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712614 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-web-config\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.712677 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712640 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-config-volume\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.712677 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712665 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.712888 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712770 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db78bd40-823a-42eb-9814-4c6372e1d872-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.712888 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712833 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.712888 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712857 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db78bd40-823a-42eb-9814-4c6372e1d872-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.712888 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712878 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.713080 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.712993 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db78bd40-823a-42eb-9814-4c6372e1d872-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.713080 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.713014 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4vcg\" (UniqueName: \"kubernetes.io/projected/db78bd40-823a-42eb-9814-4c6372e1d872-kube-api-access-t4vcg\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814040 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814009 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814207 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814047 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db78bd40-823a-42eb-9814-4c6372e1d872-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814207 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814067 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814207 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814085 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db78bd40-823a-42eb-9814-4c6372e1d872-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814207 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814109 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4vcg\" (UniqueName: \"kubernetes.io/projected/db78bd40-823a-42eb-9814-4c6372e1d872-kube-api-access-t4vcg\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814207 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814147 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814207 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814163 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814207 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814182 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db78bd40-823a-42eb-9814-4c6372e1d872-config-out\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814548 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814215 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db78bd40-823a-42eb-9814-4c6372e1d872-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814610 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814304 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-web-config\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814661 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814642 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-config-volume\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814710 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814669 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814764 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814707 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db78bd40-823a-42eb-9814-4c6372e1d872-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.814940 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.814893 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db78bd40-823a-42eb-9814-4c6372e1d872-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.815449 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.815080 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db78bd40-823a-42eb-9814-4c6372e1d872-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.815449 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.815129 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db78bd40-823a-42eb-9814-4c6372e1d872-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.817358 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.817332 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.817466 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.817382 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.817827 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.817799 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.817827 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.817820 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-config-volume\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.817965 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.817841 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.818170 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.818133 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db78bd40-823a-42eb-9814-4c6372e1d872-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.818212 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.818169 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.818212 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.818202 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db78bd40-823a-42eb-9814-4c6372e1d872-web-config\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.818584 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.818561 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db78bd40-823a-42eb-9814-4c6372e1d872-config-out\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.835818 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.835795 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4vcg\" (UniqueName: \"kubernetes.io/projected/db78bd40-823a-42eb-9814-4c6372e1d872-kube-api-access-t4vcg\") pod \"alertmanager-main-0\" (UID: \"db78bd40-823a-42eb-9814-4c6372e1d872\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:32.861673 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:32.861638 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:39:33.198677 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:33.198642 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:39:33.201749 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:39:33.201713 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb78bd40_823a_42eb_9814_4c6372e1d872.slice/crio-3a5acf73a4f6cb4bbea9eb8ed35248dd9434967d88ab0902eb1f25a3f4ac06d1 WatchSource:0}: Error finding container 3a5acf73a4f6cb4bbea9eb8ed35248dd9434967d88ab0902eb1f25a3f4ac06d1: Status 404 returned error can't find the container with id 3a5acf73a4f6cb4bbea9eb8ed35248dd9434967d88ab0902eb1f25a3f4ac06d1 Oct 30 18:39:33.436290 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:33.436254 4392 generic.go:356] "Generic (PLEG): container finished" podID="db78bd40-823a-42eb-9814-4c6372e1d872" containerID="f2a455c7d08809d888a80514ae1e7be2257e35d97c924ec5f79bf6a45f3d8318" exitCode=0 Oct 30 18:39:33.436711 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:33.436332 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db78bd40-823a-42eb-9814-4c6372e1d872","Type":"ContainerDied","Data":"f2a455c7d08809d888a80514ae1e7be2257e35d97c924ec5f79bf6a45f3d8318"} Oct 30 18:39:33.436711 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:33.436401 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db78bd40-823a-42eb-9814-4c6372e1d872","Type":"ContainerStarted","Data":"3a5acf73a4f6cb4bbea9eb8ed35248dd9434967d88ab0902eb1f25a3f4ac06d1"} Oct 30 18:39:33.785547 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:33.785520 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4cf4eb9f-1612-4e69-ae23-9d6fd959c66c" path="/var/lib/kubelet/pods/4cf4eb9f-1612-4e69-ae23-9d6fd959c66c/volumes" Oct 30 18:39:34.445089 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:34.445055 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db78bd40-823a-42eb-9814-4c6372e1d872","Type":"ContainerStarted","Data":"413fc792e2f1afa740cfdfc25dc51f0f37b9250a09dc696e1a39f69b6cd2d787"} Oct 30 18:39:34.445581 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:34.445147 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db78bd40-823a-42eb-9814-4c6372e1d872","Type":"ContainerStarted","Data":"321de272a45f0afc3fa140a26eafd1a004083e7ed1e14c96f61c9c9868d16f23"} Oct 30 18:39:34.445581 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:34.445198 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db78bd40-823a-42eb-9814-4c6372e1d872","Type":"ContainerStarted","Data":"7a8c170e74e68909c6fe8be48e23eb6470ed10f23adaf619e76208c7d61c46a5"} Oct 30 18:39:34.445581 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:34.445248 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db78bd40-823a-42eb-9814-4c6372e1d872","Type":"ContainerStarted","Data":"7eeb6b6bad5639f38bc0a1f57b64c818dc4ee079674a3f1b8a151a4bb49be996"} Oct 30 18:39:34.445581 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:34.445288 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db78bd40-823a-42eb-9814-4c6372e1d872","Type":"ContainerStarted","Data":"b7c690bc6ca8745c5d87ebdaaf4b50e6c557982b836b887f90267aa2f4e8e654"} Oct 30 18:39:34.445581 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:34.445333 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db78bd40-823a-42eb-9814-4c6372e1d872","Type":"ContainerStarted","Data":"091d141cf64860d624ebc5ed5e0f4f909fe3ad4dca69b588758c381c4bce6d29"} Oct 30 18:39:34.528022 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:34.527958 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.516032583 podStartE2EDuration="2.527935914s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.903331ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:39:34.514421087 +0000 UTC m=+136.877434517" watchObservedRunningTime="2026-10-30 18:39:34.527935914 +0000 UTC m=+136.890949282" Oct 30 18:39:35.552390 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.552358 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 18:39:35.552797 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.552645 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="prometheus" containerID="cri-o://551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b" gracePeriod=600 Oct 30 18:39:35.552797 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.552657 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy" containerID="cri-o://65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59" gracePeriod=600 Oct 30 18:39:35.552797 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.552698 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy-web" containerID="cri-o://112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726" gracePeriod=600 Oct 30 18:39:35.552797 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.552702 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80" gracePeriod=600 Oct 30 18:39:35.552797 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.552712 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="config-reloader" containerID="cri-o://103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c" gracePeriod=600 Oct 30 18:39:35.552797 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.552687 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="thanos-sidecar" containerID="cri-o://501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104" gracePeriod=600 Oct 30 18:39:35.790965 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.790940 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:35.846139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846072 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-kube-rbac-proxy\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846111 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-0\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846131 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-metrics-client-certs\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846413 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846157 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-trusted-ca-bundle\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846413 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846277 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-kubelet-serving-ca-bundle\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846413 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846332 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846413 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846365 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-tls-assets\" (UniqueName: \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-tls-assets\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846413 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846403 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-thanos-prometheus-http-client-file\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846446 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846476 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846513 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-tls\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846523 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-trusted-ca-bundle" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:35.846650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846547 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-web-config\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-web-config\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846579 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config-out\" (UniqueName: \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config-out\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846615 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-serving-certs-ca-bundle\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.846650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846648 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-2\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.847061 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846675 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-grpc-tls\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.847061 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846716 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-db\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.847061 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846743 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-metrics-client-ca\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.847061 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846771 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-1\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.847061 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.846831 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-kube-api-access-dcsrp\" (UniqueName: \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-kube-api-access-dcsrp\") pod \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\" (UID: \"c76d2acf-2e68-4c79-9a22-0a49ef77928b\") " Oct 30 18:39:35.847313 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.847140 4392 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.850722 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.847719 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-2" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:35.850722 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.848018 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-metrics-client-ca" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:35.850722 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.848732 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-serving-certs-ca-bundle" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:35.850722 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.848739 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-kubelet-serving-ca-bundle" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:35.850722 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.848827 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-db" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:39:35.850722 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.848983 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-1" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:35.850722 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.849838 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-0" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:35.851738 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.851645 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-thanos-prometheus-http-client-file" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:35.851738 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.851712 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-kube-rbac-proxy-web" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:35.852119 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.852080 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-metrics-client-certs" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:35.852642 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.852609 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-tls-assets" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:39:35.854391 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.854219 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config-out" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:39:35.854391 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.854273 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-kube-api-access-dcsrp" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "kube-api-access-dcsrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:39:35.854391 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.854289 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-thanos-sidecar-tls" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:35.854605 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.854348 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-kube-rbac-proxy" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:35.854847 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.854825 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:35.855650 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.855617 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-grpc-tls" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:35.855827 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.855793 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-tls" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:35.869578 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.869551 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-web-config" pod "c76d2acf-2e68-4c79-9a22-0a49ef77928b" (UID: "c76d2acf-2e68-4c79-9a22-0a49ef77928b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:35.948248 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948207 4392 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-web-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948248 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948242 4392 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config-out\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948248 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948254 4392 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948263 4392 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948274 4392 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-grpc-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948283 4392 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-db\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948291 4392 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-metrics-client-ca\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948299 4392 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948309 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcsrp\" (UniqueName: \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-kube-api-access-dcsrp\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948317 4392 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-kube-rbac-proxy\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948327 4392 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948335 4392 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-metrics-client-certs\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948344 4392 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c76d2acf-2e68-4c79-9a22-0a49ef77928b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948352 4392 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948361 4392 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c76d2acf-2e68-4c79-9a22-0a49ef77928b-tls-assets\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948369 4392 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948377 4392 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948385 4392 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:35.948443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:35.948394 4392 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c76d2acf-2e68-4c79-9a22-0a49ef77928b-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:39:36.456614 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456581 4392 generic.go:356] "Generic (PLEG): container finished" podID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerID="9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80" exitCode=0 Oct 30 18:39:36.456614 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456607 4392 generic.go:356] "Generic (PLEG): container finished" podID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerID="65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59" exitCode=0 Oct 30 18:39:36.456614 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456613 4392 generic.go:356] "Generic (PLEG): container finished" podID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerID="112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726" exitCode=0 Oct 30 18:39:36.456614 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456619 4392 generic.go:356] "Generic (PLEG): container finished" podID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerID="501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104" exitCode=0 Oct 30 18:39:36.456614 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456625 4392 generic.go:356] "Generic (PLEG): container finished" podID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerID="103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c" exitCode=0 Oct 30 18:39:36.457031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456630 4392 generic.go:356] "Generic (PLEG): container finished" podID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerID="551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b" exitCode=0 Oct 30 18:39:36.457031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456656 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerDied","Data":"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80"} Oct 30 18:39:36.457031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456671 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.457031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456719 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerDied","Data":"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59"} Oct 30 18:39:36.457031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456746 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerDied","Data":"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726"} Oct 30 18:39:36.457031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456768 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerDied","Data":"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104"} Oct 30 18:39:36.457031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456793 4392 scope.go:122] "RemoveContainer" containerID="9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80" Oct 30 18:39:36.457031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456798 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerDied","Data":"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c"} Oct 30 18:39:36.457031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456822 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerDied","Data":"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b"} Oct 30 18:39:36.457031 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.456844 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c76d2acf-2e68-4c79-9a22-0a49ef77928b","Type":"ContainerDied","Data":"67c2893118694cb9c720850ca149ac24dffa569ad1d051918e0878614954b7c5"} Oct 30 18:39:36.464274 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.464246 4392 scope.go:122] "RemoveContainer" containerID="65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59" Oct 30 18:39:36.471320 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.471301 4392 scope.go:122] "RemoveContainer" containerID="112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726" Oct 30 18:39:36.477807 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.477789 4392 scope.go:122] "RemoveContainer" containerID="501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104" Oct 30 18:39:36.486305 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.486286 4392 scope.go:122] "RemoveContainer" containerID="103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c" Oct 30 18:39:36.493010 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.492991 4392 scope.go:122] "RemoveContainer" containerID="551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b" Oct 30 18:39:36.499895 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.499873 4392 scope.go:122] "RemoveContainer" containerID="f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a" Oct 30 18:39:36.506278 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.506260 4392 scope.go:122] "RemoveContainer" containerID="9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80" Oct 30 18:39:36.506530 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:36.506512 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": container with ID starting with 9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80 not found: ID does not exist" containerID="9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80" Oct 30 18:39:36.506594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.506540 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80"} err="failed to get container status \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": rpc error: code = NotFound desc = could not find container \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": container with ID starting with 9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80 not found: ID does not exist" Oct 30 18:39:36.506594 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.506562 4392 scope.go:122] "RemoveContainer" containerID="65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59" Oct 30 18:39:36.506791 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:36.506775 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": container with ID starting with 65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59 not found: ID does not exist" containerID="65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59" Oct 30 18:39:36.506827 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.506794 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59"} err="failed to get container status \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": rpc error: code = NotFound desc = could not find container \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": container with ID starting with 65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59 not found: ID does not exist" Oct 30 18:39:36.506827 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.506807 4392 scope.go:122] "RemoveContainer" containerID="112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726" Oct 30 18:39:36.507093 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:36.507074 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": container with ID starting with 112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726 not found: ID does not exist" containerID="112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726" Oct 30 18:39:36.507153 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.507096 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726"} err="failed to get container status \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": rpc error: code = NotFound desc = could not find container \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": container with ID starting with 112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726 not found: ID does not exist" Oct 30 18:39:36.507153 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.507110 4392 scope.go:122] "RemoveContainer" containerID="501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104" Oct 30 18:39:36.507334 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:36.507314 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": container with ID starting with 501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104 not found: ID does not exist" containerID="501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104" Oct 30 18:39:36.507370 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.507339 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104"} err="failed to get container status \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": rpc error: code = NotFound desc = could not find container \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": container with ID starting with 501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104 not found: ID does not exist" Oct 30 18:39:36.507370 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.507352 4392 scope.go:122] "RemoveContainer" containerID="103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c" Oct 30 18:39:36.507554 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:36.507536 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": container with ID starting with 103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c not found: ID does not exist" containerID="103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c" Oct 30 18:39:36.507600 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.507560 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c"} err="failed to get container status \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": rpc error: code = NotFound desc = could not find container \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": container with ID starting with 103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c not found: ID does not exist" Oct 30 18:39:36.507600 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.507575 4392 scope.go:122] "RemoveContainer" containerID="551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b" Oct 30 18:39:36.507776 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:36.507758 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": container with ID starting with 551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b not found: ID does not exist" containerID="551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b" Oct 30 18:39:36.507809 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.507780 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b"} err="failed to get container status \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": rpc error: code = NotFound desc = could not find container \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": container with ID starting with 551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b not found: ID does not exist" Oct 30 18:39:36.507809 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.507793 4392 scope.go:122] "RemoveContainer" containerID="f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a" Oct 30 18:39:36.507996 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:36.507979 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": container with ID starting with f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a not found: ID does not exist" containerID="f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a" Oct 30 18:39:36.508061 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.507998 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a"} err="failed to get container status \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": rpc error: code = NotFound desc = could not find container \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": container with ID starting with f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a not found: ID does not exist" Oct 30 18:39:36.508061 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.508010 4392 scope.go:122] "RemoveContainer" containerID="9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80" Oct 30 18:39:36.508232 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.508213 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80"} err="failed to get container status \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": rpc error: code = NotFound desc = could not find container \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": container with ID starting with 9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80 not found: ID does not exist" Oct 30 18:39:36.508272 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.508231 4392 scope.go:122] "RemoveContainer" containerID="65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59" Oct 30 18:39:36.508431 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.508413 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59"} err="failed to get container status \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": rpc error: code = NotFound desc = could not find container \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": container with ID starting with 65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59 not found: ID does not exist" Oct 30 18:39:36.508466 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.508431 4392 scope.go:122] "RemoveContainer" containerID="112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726" Oct 30 18:39:36.508620 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.508606 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726"} err="failed to get container status \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": rpc error: code = NotFound desc = could not find container \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": container with ID starting with 112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726 not found: ID does not exist" Oct 30 18:39:36.508656 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.508619 4392 scope.go:122] "RemoveContainer" containerID="501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104" Oct 30 18:39:36.508814 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.508797 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104"} err="failed to get container status \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": rpc error: code = NotFound desc = could not find container \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": container with ID starting with 501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104 not found: ID does not exist" Oct 30 18:39:36.508814 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.508813 4392 scope.go:122] "RemoveContainer" containerID="103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c" Oct 30 18:39:36.509039 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509016 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c"} err="failed to get container status \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": rpc error: code = NotFound desc = could not find container \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": container with ID starting with 103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c not found: ID does not exist" Oct 30 18:39:36.509110 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509041 4392 scope.go:122] "RemoveContainer" containerID="551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b" Oct 30 18:39:36.509257 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509242 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b"} err="failed to get container status \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": rpc error: code = NotFound desc = could not find container \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": container with ID starting with 551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b not found: ID does not exist" Oct 30 18:39:36.509304 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509257 4392 scope.go:122] "RemoveContainer" containerID="f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a" Oct 30 18:39:36.509432 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509417 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a"} err="failed to get container status \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": rpc error: code = NotFound desc = could not find container \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": container with ID starting with f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a not found: ID does not exist" Oct 30 18:39:36.509474 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509431 4392 scope.go:122] "RemoveContainer" containerID="9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80" Oct 30 18:39:36.509602 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509585 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80"} err="failed to get container status \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": rpc error: code = NotFound desc = could not find container \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": container with ID starting with 9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80 not found: ID does not exist" Oct 30 18:39:36.509643 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509601 4392 scope.go:122] "RemoveContainer" containerID="65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59" Oct 30 18:39:36.509769 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509753 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59"} err="failed to get container status \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": rpc error: code = NotFound desc = could not find container \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": container with ID starting with 65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59 not found: ID does not exist" Oct 30 18:39:36.509769 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509768 4392 scope.go:122] "RemoveContainer" containerID="112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726" Oct 30 18:39:36.509971 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509952 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726"} err="failed to get container status \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": rpc error: code = NotFound desc = could not find container \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": container with ID starting with 112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726 not found: ID does not exist" Oct 30 18:39:36.510049 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.509973 4392 scope.go:122] "RemoveContainer" containerID="501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104" Oct 30 18:39:36.510190 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.510175 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104"} err="failed to get container status \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": rpc error: code = NotFound desc = could not find container \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": container with ID starting with 501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104 not found: ID does not exist" Oct 30 18:39:36.510236 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.510189 4392 scope.go:122] "RemoveContainer" containerID="103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c" Oct 30 18:39:36.510376 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.510359 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c"} err="failed to get container status \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": rpc error: code = NotFound desc = could not find container \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": container with ID starting with 103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c not found: ID does not exist" Oct 30 18:39:36.510376 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.510375 4392 scope.go:122] "RemoveContainer" containerID="551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b" Oct 30 18:39:36.510551 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.510535 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b"} err="failed to get container status \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": rpc error: code = NotFound desc = could not find container \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": container with ID starting with 551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b not found: ID does not exist" Oct 30 18:39:36.510592 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.510551 4392 scope.go:122] "RemoveContainer" containerID="f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a" Oct 30 18:39:36.510721 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.510705 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a"} err="failed to get container status \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": rpc error: code = NotFound desc = could not find container \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": container with ID starting with f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a not found: ID does not exist" Oct 30 18:39:36.510721 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.510720 4392 scope.go:122] "RemoveContainer" containerID="9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80" Oct 30 18:39:36.510899 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.510883 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80"} err="failed to get container status \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": rpc error: code = NotFound desc = could not find container \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": container with ID starting with 9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80 not found: ID does not exist" Oct 30 18:39:36.510899 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.510898 4392 scope.go:122] "RemoveContainer" containerID="65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59" Oct 30 18:39:36.511139 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.511119 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59"} err="failed to get container status \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": rpc error: code = NotFound desc = could not find container \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": container with ID starting with 65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59 not found: ID does not exist" Oct 30 18:39:36.511216 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.511140 4392 scope.go:122] "RemoveContainer" containerID="112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726" Oct 30 18:39:36.511368 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.511349 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726"} err="failed to get container status \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": rpc error: code = NotFound desc = could not find container \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": container with ID starting with 112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726 not found: ID does not exist" Oct 30 18:39:36.511368 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.511368 4392 scope.go:122] "RemoveContainer" containerID="501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104" Oct 30 18:39:36.511558 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.511542 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104"} err="failed to get container status \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": rpc error: code = NotFound desc = could not find container \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": container with ID starting with 501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104 not found: ID does not exist" Oct 30 18:39:36.511599 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.511558 4392 scope.go:122] "RemoveContainer" containerID="103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c" Oct 30 18:39:36.511737 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.511721 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c"} err="failed to get container status \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": rpc error: code = NotFound desc = could not find container \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": container with ID starting with 103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c not found: ID does not exist" Oct 30 18:39:36.511737 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.511737 4392 scope.go:122] "RemoveContainer" containerID="551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b" Oct 30 18:39:36.511920 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.511891 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b"} err="failed to get container status \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": rpc error: code = NotFound desc = could not find container \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": container with ID starting with 551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b not found: ID does not exist" Oct 30 18:39:36.511984 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.511921 4392 scope.go:122] "RemoveContainer" containerID="f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a" Oct 30 18:39:36.512121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.512106 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a"} err="failed to get container status \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": rpc error: code = NotFound desc = could not find container \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": container with ID starting with f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a not found: ID does not exist" Oct 30 18:39:36.512121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.512120 4392 scope.go:122] "RemoveContainer" containerID="9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80" Oct 30 18:39:36.512308 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.512294 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80"} err="failed to get container status \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": rpc error: code = NotFound desc = could not find container \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": container with ID starting with 9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80 not found: ID does not exist" Oct 30 18:39:36.512342 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.512308 4392 scope.go:122] "RemoveContainer" containerID="65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59" Oct 30 18:39:36.512499 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.512484 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59"} err="failed to get container status \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": rpc error: code = NotFound desc = could not find container \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": container with ID starting with 65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59 not found: ID does not exist" Oct 30 18:39:36.512544 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.512499 4392 scope.go:122] "RemoveContainer" containerID="112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726" Oct 30 18:39:36.512695 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.512674 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726"} err="failed to get container status \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": rpc error: code = NotFound desc = could not find container \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": container with ID starting with 112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726 not found: ID does not exist" Oct 30 18:39:36.512763 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.512696 4392 scope.go:122] "RemoveContainer" containerID="501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104" Oct 30 18:39:36.512936 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.512902 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104"} err="failed to get container status \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": rpc error: code = NotFound desc = could not find container \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": container with ID starting with 501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104 not found: ID does not exist" Oct 30 18:39:36.512981 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.512936 4392 scope.go:122] "RemoveContainer" containerID="103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c" Oct 30 18:39:36.513160 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.513131 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c"} err="failed to get container status \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": rpc error: code = NotFound desc = could not find container \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": container with ID starting with 103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c not found: ID does not exist" Oct 30 18:39:36.513227 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.513162 4392 scope.go:122] "RemoveContainer" containerID="551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b" Oct 30 18:39:36.513521 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.513467 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b"} err="failed to get container status \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": rpc error: code = NotFound desc = could not find container \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": container with ID starting with 551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b not found: ID does not exist" Oct 30 18:39:36.513521 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.513493 4392 scope.go:122] "RemoveContainer" containerID="f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a" Oct 30 18:39:36.513936 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.513893 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a"} err="failed to get container status \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": rpc error: code = NotFound desc = could not find container \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": container with ID starting with f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a not found: ID does not exist" Oct 30 18:39:36.514023 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.513940 4392 scope.go:122] "RemoveContainer" containerID="9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80" Oct 30 18:39:36.514200 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.514180 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80"} err="failed to get container status \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": rpc error: code = NotFound desc = could not find container \"9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80\": container with ID starting with 9b065faeb1d6681d8e7b1b4a3123b44a728e2c60837b1fd9d07593562b749e80 not found: ID does not exist" Oct 30 18:39:36.514258 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.514200 4392 scope.go:122] "RemoveContainer" containerID="65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59" Oct 30 18:39:36.514455 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.514436 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59"} err="failed to get container status \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": rpc error: code = NotFound desc = could not find container \"65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59\": container with ID starting with 65f0e58abacf4452280e02925305262cac332aeb197fffad57e2785087af0f59 not found: ID does not exist" Oct 30 18:39:36.514509 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.514456 4392 scope.go:122] "RemoveContainer" containerID="112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726" Oct 30 18:39:36.514740 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.514724 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726"} err="failed to get container status \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": rpc error: code = NotFound desc = could not find container \"112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726\": container with ID starting with 112ba14b50b6ea0ec8056b324eb7d5e3969f83d6477f6bd18e7039efbeb9e726 not found: ID does not exist" Oct 30 18:39:36.514740 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.514739 4392 scope.go:122] "RemoveContainer" containerID="501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104" Oct 30 18:39:36.514875 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.514856 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 18:39:36.514990 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.514972 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104"} err="failed to get container status \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": rpc error: code = NotFound desc = could not find container \"501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104\": container with ID starting with 501eafaa07353b9447e25415459b74146821e58036df7d7a4708b07247a57104 not found: ID does not exist" Oct 30 18:39:36.515041 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.514991 4392 scope.go:122] "RemoveContainer" containerID="103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c" Oct 30 18:39:36.515206 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.515187 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c"} err="failed to get container status \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": rpc error: code = NotFound desc = could not find container \"103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c\": container with ID starting with 103568d17f996c387a784d562ed8e15b2be84f11f235ba5772b018922e1dd44c not found: ID does not exist" Oct 30 18:39:36.515248 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.515206 4392 scope.go:122] "RemoveContainer" containerID="551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b" Oct 30 18:39:36.515431 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.515414 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b"} err="failed to get container status \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": rpc error: code = NotFound desc = could not find container \"551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b\": container with ID starting with 551dd74f943d207a075348704dbfa7ba15ea6647388cf76bdaeeca8463b86c9b not found: ID does not exist" Oct 30 18:39:36.515470 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.515431 4392 scope.go:122] "RemoveContainer" containerID="f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a" Oct 30 18:39:36.515637 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.515618 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a"} err="failed to get container status \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": rpc error: code = NotFound desc = could not find container \"f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a\": container with ID starting with f0eb5118e2cc9213ad1ad31d4be32bdf4812c932eb99269f28bd10e43629dc5a not found: ID does not exist" Oct 30 18:39:36.528131 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.528104 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 18:39:36.547133 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547108 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 18:39:36.547400 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547389 4392 cpu_manager.go:414] "containerMap: removing container" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="init-config-reloader" Oct 30 18:39:36.547439 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547402 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="init-config-reloader" Oct 30 18:39:36.547439 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547418 4392 cpu_manager.go:414] "containerMap: removing container" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="config-reloader" Oct 30 18:39:36.547439 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547424 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="config-reloader" Oct 30 18:39:36.547439 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547432 4392 cpu_manager.go:414] "containerMap: removing container" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="thanos-sidecar" Oct 30 18:39:36.547439 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547437 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="thanos-sidecar" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547451 4392 cpu_manager.go:414] "containerMap: removing container" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547456 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547463 4392 cpu_manager.go:414] "containerMap: removing container" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy-thanos" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547468 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy-thanos" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547476 4392 cpu_manager.go:414] "containerMap: removing container" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="prometheus" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547481 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="prometheus" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547490 4392 cpu_manager.go:414] "containerMap: removing container" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy-web" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547494 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy-web" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547547 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="config-reloader" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547554 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="thanos-sidecar" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547562 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547568 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy-thanos" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547574 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="prometheus" Oct 30 18:39:36.547577 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.547579 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" containerName="kube-rbac-proxy-web" Oct 30 18:39:36.552832 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.552815 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.569608 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.569583 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Oct 30 18:39:36.569837 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.569658 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Oct 30 18:39:36.569837 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.569671 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Oct 30 18:39:36.569960 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.569886 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Oct 30 18:39:36.570010 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.569971 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Oct 30 18:39:36.570010 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.569976 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Oct 30 18:39:36.570097 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.570000 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Oct 30 18:39:36.570097 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.570045 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7265990njcmgq\"" Oct 30 18:39:36.570203 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.570098 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Oct 30 18:39:36.570255 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.570211 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Oct 30 18:39:36.570255 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.570223 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-snpb4\"" Oct 30 18:39:36.570333 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.570279 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Oct 30 18:39:36.570333 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.570325 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Oct 30 18:39:36.570426 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.570411 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Oct 30 18:39:36.583862 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.583837 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Oct 30 18:39:36.583967 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.583843 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Oct 30 18:39:36.585089 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.585065 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 18:39:36.653632 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.653590 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.653632 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.653634 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.653899 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.653663 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.653899 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.653784 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.653899 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.653819 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.653899 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.653850 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-config\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.653899 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.653875 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43d225eb-51a0-4da0-912a-58b904babd25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654253 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.653947 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43d225eb-51a0-4da0-912a-58b904babd25-config-out\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654253 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.653999 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654253 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654026 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654253 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654052 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-web-config\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654253 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654073 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654253 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654165 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654253 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654206 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654253 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654253 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654546 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654285 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654546 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654344 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654546 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654362 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7tp8\" (UniqueName: \"kubernetes.io/projected/43d225eb-51a0-4da0-912a-58b904babd25-kube-api-access-k7tp8\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654546 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654381 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.654546 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.654402 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755334 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755233 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43d225eb-51a0-4da0-912a-58b904babd25-config-out\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755334 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755286 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755334 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755317 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755618 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755357 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-web-config\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755618 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755385 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755618 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755413 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755618 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755460 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755618 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755507 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755618 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755540 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755618 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755568 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.755618 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755596 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7tp8\" (UniqueName: \"kubernetes.io/projected/43d225eb-51a0-4da0-912a-58b904babd25-kube-api-access-k7tp8\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756049 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755630 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756049 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755665 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756049 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755699 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756049 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755745 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756049 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755767 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756049 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755805 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756049 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755829 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756049 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755854 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-config\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756049 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.755876 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43d225eb-51a0-4da0-912a-58b904babd25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756491 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.756107 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.756491 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.756323 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.758267 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.758240 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43d225eb-51a0-4da0-912a-58b904babd25-config-out\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.758544 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.758511 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-web-config\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.758661 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.758582 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.758661 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.758619 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.758863 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.758841 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.758989 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.758967 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.760331 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.759773 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.760331 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.759988 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.760331 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.759993 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.760331 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.760075 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.760331 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.760095 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.760331 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.760451 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43d225eb-51a0-4da0-912a-58b904babd25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.760972 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.760949 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-config\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.761038 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.760973 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.761717 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.761689 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.761992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.761974 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43d225eb-51a0-4da0-912a-58b904babd25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.762756 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.762739 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43d225eb-51a0-4da0-912a-58b904babd25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.780437 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.780417 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7tp8\" (UniqueName: \"kubernetes.io/projected/43d225eb-51a0-4da0-912a-58b904babd25-kube-api-access-k7tp8\") pod \"prometheus-k8s-0\" (UID: \"43d225eb-51a0-4da0-912a-58b904babd25\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:36.878802 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:36.878764 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:37.217633 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:37.217534 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 18:39:37.220131 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:39:37.220105 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d225eb_51a0_4da0_912a_58b904babd25.slice/crio-3fe57c558f459f155fa9bf70f587bd30ddb845d184ad64f5b2d606863ad3b614 WatchSource:0}: Error finding container 3fe57c558f459f155fa9bf70f587bd30ddb845d184ad64f5b2d606863ad3b614: Status 404 returned error can't find the container with id 3fe57c558f459f155fa9bf70f587bd30ddb845d184ad64f5b2d606863ad3b614 Oct 30 18:39:37.462476 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:37.462443 4392 generic.go:356] "Generic (PLEG): container finished" podID="43d225eb-51a0-4da0-912a-58b904babd25" containerID="955f50aca2d021f0a4bcc7739543b9fd98bdcfbba8e24fc0e11288bc52e9b665" exitCode=0 Oct 30 18:39:37.462476 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:37.462479 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d225eb-51a0-4da0-912a-58b904babd25","Type":"ContainerDied","Data":"955f50aca2d021f0a4bcc7739543b9fd98bdcfbba8e24fc0e11288bc52e9b665"} Oct 30 18:39:37.462648 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:37.462527 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d225eb-51a0-4da0-912a-58b904babd25","Type":"ContainerStarted","Data":"3fe57c558f459f155fa9bf70f587bd30ddb845d184ad64f5b2d606863ad3b614"} Oct 30 18:39:37.786697 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:37.786213 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c76d2acf-2e68-4c79-9a22-0a49ef77928b" path="/var/lib/kubelet/pods/c76d2acf-2e68-4c79-9a22-0a49ef77928b/volumes" Oct 30 18:39:38.470793 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:38.470759 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d225eb-51a0-4da0-912a-58b904babd25","Type":"ContainerStarted","Data":"cfb82a156c0ffcd7e643cf603c55a46f6f4f6cf71cbfaa4524d1436c534a3126"} Oct 30 18:39:38.470990 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:38.470824 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d225eb-51a0-4da0-912a-58b904babd25","Type":"ContainerStarted","Data":"00dfa7296ef49a7c181a92c29d8dc22ceff3d845c1da623d31a958a867b59991"} Oct 30 18:39:38.470990 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:38.470850 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d225eb-51a0-4da0-912a-58b904babd25","Type":"ContainerStarted","Data":"8be16a33edf1a552ecbe28af750d150ba64922a4cc5c5b6edc3b0659ca468c69"} Oct 30 18:39:38.470990 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:38.470874 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d225eb-51a0-4da0-912a-58b904babd25","Type":"ContainerStarted","Data":"b1444c18bcb212a2c7d9ee85c3a23983d87afffac2363435aff7e79e20ff75f8"} Oct 30 18:39:38.470990 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:38.470897 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d225eb-51a0-4da0-912a-58b904babd25","Type":"ContainerStarted","Data":"3e9de59d600028d1f6cbc0012d9519d29ea2192c84b60334edaed9a34da0193d"} Oct 30 18:39:38.470990 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:38.470936 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d225eb-51a0-4da0-912a-58b904babd25","Type":"ContainerStarted","Data":"fb237588a7ad94fd434b1cd5986fc9ef8e6013e383356168f3c9320a19ba2093"} Oct 30 18:39:38.541297 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:38.541242 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.521963192 podStartE2EDuration="2.541227306s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.264114ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:39:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:39:38.539562995 +0000 UTC m=+140.902576363" watchObservedRunningTime="2026-10-30 18:39:38.541227306 +0000 UTC m=+140.904240672" Oct 30 18:39:41.879203 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:39:41.879165 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:39:53.874322 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:39:53.874286 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:40:23.875025 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:40:23.874984 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:40:36.879933 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:40:36.879865 4392 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:40:36.896119 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:40:36.896091 4392 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:40:37.710660 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:40:37.710632 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 18:40:53.875460 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:40:53.875417 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:41:23.874443 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:41:23.874402 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:41:53.875256 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:41:53.875216 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:42:23.874929 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:42:23.874864 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:42:53.873937 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:42:53.873840 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:43:23.875244 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:43:23.875208 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:43:53.874237 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:43:53.874190 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:44:23.874085 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:44:23.874009 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:44:53.874108 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:44:53.874072 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:45:23.874324 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:45:23.874285 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:45:53.874735 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:45:53.874659 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:46:23.873562 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:46:23.873513 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:46:53.874684 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:46:53.874645 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:47:01.267502 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.267304 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/s3-init-hhzfz"] Oct 30 18:47:01.272416 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.272393 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-hhzfz" Oct 30 18:47:01.302731 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.302706 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-hhzfz"] Oct 30 18:47:01.314331 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.314309 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Oct 30 18:47:01.314331 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.314324 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Oct 30 18:47:01.374775 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.374752 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Oct 30 18:47:01.374775 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.374762 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Oct 30 18:47:01.375016 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.374947 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-xzbb7\"" Oct 30 18:47:01.442766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.442740 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbrz8\" (UniqueName: \"kubernetes.io/projected/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-kube-api-access-mbrz8\") pod \"s3-init-hhzfz\" (UID: \"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61\") " pod="kserve/s3-init-hhzfz" Oct 30 18:47:01.442889 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.442777 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-model-cache\") pod \"s3-init-hhzfz\" (UID: \"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61\") " pod="kserve/s3-init-hhzfz" Oct 30 18:47:01.543978 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.543874 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbrz8\" (UniqueName: \"kubernetes.io/projected/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-kube-api-access-mbrz8\") pod \"s3-init-hhzfz\" (UID: \"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61\") " pod="kserve/s3-init-hhzfz" Oct 30 18:47:01.543978 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.543943 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-model-cache\") pod \"s3-init-hhzfz\" (UID: \"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61\") " pod="kserve/s3-init-hhzfz" Oct 30 18:47:01.544321 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.544303 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-model-cache\") pod \"s3-init-hhzfz\" (UID: \"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61\") " pod="kserve/s3-init-hhzfz" Oct 30 18:47:01.566266 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.566239 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbrz8\" (UniqueName: \"kubernetes.io/projected/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-kube-api-access-mbrz8\") pod \"s3-init-hhzfz\" (UID: \"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61\") " pod="kserve/s3-init-hhzfz" Oct 30 18:47:01.596727 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.596700 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-hhzfz" Oct 30 18:47:01.900540 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.900452 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-hhzfz"] Oct 30 18:47:01.904516 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:47:01.904480 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0ac8e0e_9c09_4c77_b90a_f5c1010bbe61.slice/crio-7594bd4f2384c2d923414f6f20e6a05d1368cc4f30d5626b986c70b4a30be30b WatchSource:0}: Error finding container 7594bd4f2384c2d923414f6f20e6a05d1368cc4f30d5626b986c70b4a30be30b: Status 404 returned error can't find the container with id 7594bd4f2384c2d923414f6f20e6a05d1368cc4f30d5626b986c70b4a30be30b Oct 30 18:47:01.906354 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:01.906336 4392 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 18:47:02.099647 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:02.099616 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hhzfz" event={"ID":"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61","Type":"ContainerStarted","Data":"7594bd4f2384c2d923414f6f20e6a05d1368cc4f30d5626b986c70b4a30be30b"} Oct 30 18:47:06.118443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:06.118407 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hhzfz" event={"ID":"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61","Type":"ContainerStarted","Data":"9a9321671899afb043d7adf43e2a459fb5e9aa20945da0fb500c42d579d10209"} Oct 30 18:47:07.123775 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:07.123688 4392 generic.go:356] "Generic (PLEG): container finished" podID="b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61" containerID="9a9321671899afb043d7adf43e2a459fb5e9aa20945da0fb500c42d579d10209" exitCode=0 Oct 30 18:47:07.124162 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:07.123776 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hhzfz" event={"ID":"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61","Type":"ContainerDied","Data":"9a9321671899afb043d7adf43e2a459fb5e9aa20945da0fb500c42d579d10209"} Oct 30 18:47:12.148447 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:12.148407 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hhzfz" event={"ID":"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61","Type":"ContainerStarted","Data":"8a2dda6bf4e8a39a8eee41fb8b5dfe3b15fbfb5964fce40e904c229534801e6e"} Oct 30 18:47:12.193188 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:47:12.193138 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/s3-init-hhzfz" podStartSLOduration=2.2109847719999998 podStartE2EDuration="11.193125493s" totalImagesPullingTime="7.907343259s" totalInitContainerRuntime="1.074797462s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:47:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:47:12.192611652 +0000 UTC m=+594.555625015" watchObservedRunningTime="2026-10-30 18:47:12.193125493 +0000 UTC m=+594.556138859" Oct 30 18:47:23.873546 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:47:23.873505 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:47:53.873486 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:47:53.873446 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:48:17.389209 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:17.389171 4392 generic.go:356] "Generic (PLEG): container finished" podID="b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61" containerID="8a2dda6bf4e8a39a8eee41fb8b5dfe3b15fbfb5964fce40e904c229534801e6e" exitCode=0 Oct 30 18:48:17.389596 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:17.389244 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hhzfz" event={"ID":"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61","Type":"ContainerDied","Data":"8a2dda6bf4e8a39a8eee41fb8b5dfe3b15fbfb5964fce40e904c229534801e6e"} Oct 30 18:48:18.524146 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:18.524115 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-hhzfz" Oct 30 18:48:18.586465 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:18.586434 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-kube-api-access-mbrz8\" (UniqueName: \"kubernetes.io/projected/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-kube-api-access-mbrz8\") pod \"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61\" (UID: \"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61\") " Oct 30 18:48:18.586666 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:18.586509 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-model-cache\") pod \"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61\" (UID: \"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61\") " Oct 30 18:48:18.588589 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:18.588560 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-kube-api-access-mbrz8" pod "b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61" (UID: "b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61"). InnerVolumeSpecName "kube-api-access-mbrz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:48:18.604355 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:18.604312 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-model-cache" pod "b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61" (UID: "b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:48:18.687766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:18.687739 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbrz8\" (UniqueName: \"kubernetes.io/projected/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-kube-api-access-mbrz8\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:48:18.687766 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:18.687765 4392 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61-model-cache\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:48:19.397548 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:19.397508 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hhzfz" event={"ID":"b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61","Type":"ContainerDied","Data":"7594bd4f2384c2d923414f6f20e6a05d1368cc4f30d5626b986c70b4a30be30b"} Oct 30 18:48:19.397548 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:19.397529 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-hhzfz" Oct 30 18:48:19.397548 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:19.397553 4392 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7594bd4f2384c2d923414f6f20e6a05d1368cc4f30d5626b986c70b4a30be30b" Oct 30 18:48:23.874201 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:48:23.874165 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:48:53.874484 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:48:53.874405 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:48:57.674708 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.674674 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb"] Oct 30 18:48:57.675133 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.675076 4392 cpu_manager.go:414] "containerMap: removing container" podUID="b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61" containerName="s3-init" Oct 30 18:48:57.675133 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.675090 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61" containerName="s3-init" Oct 30 18:48:57.675133 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.675114 4392 cpu_manager.go:414] "containerMap: removing container" podUID="b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61" containerName="download-hf-model" Oct 30 18:48:57.675133 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.675120 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61" containerName="download-hf-model" Oct 30 18:48:57.675264 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.675179 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0ac8e0e-9c09-4c77-b90a-f5c1010bbe61" containerName="s3-init" Oct 30 18:48:57.678400 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.678383 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.698729 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.698705 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"openshift-service-ca.crt\"" Oct 30 18:48:57.698855 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.698840 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"kube-root-ca.crt\"" Oct 30 18:48:57.700179 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.700163 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"seaweedfs-s3-creds\"" Oct 30 18:48:57.700179 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.700167 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"isvc-canary-rollback-v2-predictor-serving-cert\"" Oct 30 18:48:57.704432 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.704412 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-cabundle-cert\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.704537 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.704460 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd825\" (UniqueName: \"kubernetes.io/projected/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-api-access-vd825\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.704537 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.704486 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.704656 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.704636 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-proxy-tls\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.704719 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.704701 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kserve-provision-location\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.713603 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.713580 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb"] Oct 30 18:48:57.797495 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.797469 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 18:48:57.797633 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.797605 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\"" Oct 30 18:48:57.797676 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.797659 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"default-dockercfg-gh4qc\"" Oct 30 18:48:57.806030 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.806008 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd825\" (UniqueName: \"kubernetes.io/projected/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-api-access-vd825\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.806086 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.806035 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.806086 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.806078 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-proxy-tls\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.806159 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.806109 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kserve-provision-location\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.806159 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.806135 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-cabundle-cert\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.806571 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.806550 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kserve-provision-location\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.806736 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.806717 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.806779 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.806765 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-cabundle-cert\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.808531 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.808509 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-proxy-tls\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.826957 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.826929 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd825\" (UniqueName: \"kubernetes.io/projected/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-api-access-vd825\") pod \"isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:57.994865 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:57.994782 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:48:58.032668 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.032634 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d"] Oct 30 18:48:58.036309 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.036287 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.055725 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.055702 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"isvc-canary-rollback-predictor-serving-cert\"" Oct 30 18:48:58.064305 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.064276 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d"] Oct 30 18:48:58.108417 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.108384 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfq7j\" (UniqueName: \"kubernetes.io/projected/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-api-access-xfq7j\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.108559 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.108482 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-cabundle-cert\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.108559 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.108544 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.108652 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.108575 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.108652 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.108602 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/02c1e68b-c2d8-4459-86ba-ca7059b285b9-proxy-tls\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.209957 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.209923 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfq7j\" (UniqueName: \"kubernetes.io/projected/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-api-access-xfq7j\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.209957 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.209963 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-cabundle-cert\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.210184 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.210002 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.210184 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.210022 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.210184 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.210046 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/02c1e68b-c2d8-4459-86ba-ca7059b285b9-proxy-tls\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.210459 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.210438 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.210638 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.210619 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.210750 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.210733 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-cabundle-cert\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.212378 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.212355 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/02c1e68b-c2d8-4459-86ba-ca7059b285b9-proxy-tls\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.236105 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.236080 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfq7j\" (UniqueName: \"kubernetes.io/projected/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-api-access-xfq7j\") pod \"isvc-canary-rollback-predictor-95869db44-slh7d\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.315829 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.315639 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb"] Oct 30 18:48:58.318379 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:48:58.318350 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36abaf9a_7ba3_4c6f_ad68_cefc4c4c5cea.slice/crio-1517fbdc7c6545e2dec68be2cada1e34a5018389b21f9cd453ee1d880d872133 WatchSource:0}: Error finding container 1517fbdc7c6545e2dec68be2cada1e34a5018389b21f9cd453ee1d880d872133: Status 404 returned error can't find the container with id 1517fbdc7c6545e2dec68be2cada1e34a5018389b21f9cd453ee1d880d872133 Oct 30 18:48:58.355448 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.355424 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:48:58.539203 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.539168 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" event={"ID":"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea","Type":"ContainerStarted","Data":"15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def"} Oct 30 18:48:58.539400 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.539224 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" event={"ID":"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea","Type":"ContainerStarted","Data":"1517fbdc7c6545e2dec68be2cada1e34a5018389b21f9cd453ee1d880d872133"} Oct 30 18:48:58.678259 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:58.678228 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d"] Oct 30 18:48:58.682086 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:48:58.682057 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c1e68b_c2d8_4459_86ba_ca7059b285b9.slice/crio-be26d20e5520bbb2ba85e4530bf9acdbd8ee042e8c9b110a9932947ae67a99e4 WatchSource:0}: Error finding container be26d20e5520bbb2ba85e4530bf9acdbd8ee042e8c9b110a9932947ae67a99e4: Status 404 returned error can't find the container with id be26d20e5520bbb2ba85e4530bf9acdbd8ee042e8c9b110a9932947ae67a99e4 Oct 30 18:48:59.545131 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:59.545087 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" event={"ID":"02c1e68b-c2d8-4459-86ba-ca7059b285b9","Type":"ContainerStarted","Data":"9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f"} Oct 30 18:48:59.545295 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:48:59.545164 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" event={"ID":"02c1e68b-c2d8-4459-86ba-ca7059b285b9","Type":"ContainerStarted","Data":"be26d20e5520bbb2ba85e4530bf9acdbd8ee042e8c9b110a9932947ae67a99e4"} Oct 30 18:49:02.557105 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:02.557065 4392 generic.go:356] "Generic (PLEG): container finished" podID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerID="15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def" exitCode=0 Oct 30 18:49:02.557576 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:02.557144 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" event={"ID":"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea","Type":"ContainerDied","Data":"15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def"} Oct 30 18:49:03.565224 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:03.565180 4392 generic.go:356] "Generic (PLEG): container finished" podID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerID="9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f" exitCode=0 Oct 30 18:49:03.565715 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:03.565297 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" event={"ID":"02c1e68b-c2d8-4459-86ba-ca7059b285b9","Type":"ContainerDied","Data":"9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f"} Oct 30 18:49:23.703642 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:23.703600 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" event={"ID":"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea","Type":"ContainerStarted","Data":"10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07"} Oct 30 18:49:23.706152 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:23.706125 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" event={"ID":"02c1e68b-c2d8-4459-86ba-ca7059b285b9","Type":"ContainerStarted","Data":"57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c"} Oct 30 18:49:23.898748 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:49:23.898708 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:49:25.716482 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:25.716448 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" event={"ID":"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea","Type":"ContainerStarted","Data":"97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545"} Oct 30 18:49:25.716970 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:25.716582 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:49:25.718517 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:25.718491 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" event={"ID":"02c1e68b-c2d8-4459-86ba-ca7059b285b9","Type":"ContainerStarted","Data":"f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f"} Oct 30 18:49:25.718620 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:25.718602 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:49:25.718670 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:25.718639 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:49:25.719826 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:25.719798 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Oct 30 18:49:25.789196 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:25.789092 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podStartSLOduration=2.219150016 podStartE2EDuration="28.789074587s" totalImagesPullingTime="22.83424947s" totalInitContainerRuntime="3.735675101s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:48:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:49:25.786987545 +0000 UTC m=+728.150000912" watchObservedRunningTime="2026-10-30 18:49:25.789074587 +0000 UTC m=+728.152087962" Oct 30 18:49:25.842997 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:25.842951 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podStartSLOduration=2.016505933 podStartE2EDuration="27.842938577s" totalImagesPullingTime="21.888674702s" totalInitContainerRuntime="3.937757942s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:48:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:49:25.841982149 +0000 UTC m=+728.204995514" watchObservedRunningTime="2026-10-30 18:49:25.842938577 +0000 UTC m=+728.205951939" Oct 30 18:49:26.722955 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:26.722901 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Oct 30 18:49:26.723412 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:26.723020 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:49:26.723826 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:26.723801 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Oct 30 18:49:27.725929 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:27.725877 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Oct 30 18:49:31.726893 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:31.726866 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:49:31.727556 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:31.727529 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Oct 30 18:49:32.730843 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:32.730813 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:49:32.731449 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:32.731420 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Oct 30 18:49:41.727628 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:41.727586 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Oct 30 18:49:42.732368 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:42.732324 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Oct 30 18:49:51.727622 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:51.727574 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Oct 30 18:49:52.731675 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:49:52.731629 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Oct 30 18:49:53.874542 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:49:53.874505 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:50:01.727661 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:01.727574 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Oct 30 18:50:02.731413 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:02.731372 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Oct 30 18:50:11.728202 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:11.728161 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Oct 30 18:50:12.731899 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:12.731861 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Oct 30 18:50:21.728121 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:21.728080 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Oct 30 18:50:22.731734 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:22.731689 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Oct 30 18:50:23.873736 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:50:23.873704 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:50:31.727996 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:31.727948 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Oct 30 18:50:32.732288 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:32.732244 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Oct 30 18:50:41.728731 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:41.728699 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:50:42.731975 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:42.731949 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:50:47.655195 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:47.655155 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb"] Oct 30 18:50:47.655657 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:47.655423 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" containerID="cri-o://10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07" gracePeriod=30 Oct 30 18:50:47.655657 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:47.655443 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kube-rbac-proxy" containerID="cri-o://97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545" gracePeriod=30 Oct 30 18:50:47.726634 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:47.726599 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.23:8643/healthz\": dial tcp 10.132.0.23:8643: connect: connection refused" Oct 30 18:50:48.037505 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:48.037472 4392 generic.go:356] "Generic (PLEG): container finished" podID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerID="97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545" exitCode=0 Oct 30 18:50:48.037704 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:48.037544 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" event={"ID":"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea","Type":"ContainerDied","Data":"97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545"} Oct 30 18:50:52.488780 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.488758 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:50:52.504661 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.504633 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-rbac-proxy-sar-config\") pod \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " Oct 30 18:50:52.504772 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.504698 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-api-access-vd825\" (UniqueName: \"kubernetes.io/projected/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-api-access-vd825\") pod \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " Oct 30 18:50:52.504839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.504826 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-proxy-tls\" (UniqueName: \"kubernetes.io/secret/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-proxy-tls\") pod \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " Oct 30 18:50:52.504880 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.504849 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kserve-provision-location\") pod \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " Oct 30 18:50:52.504935 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.504893 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-cabundle-cert\") pod \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\" (UID: \"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea\") " Oct 30 18:50:52.505023 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.504990 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-rbac-proxy-sar-config" pod "36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" (UID: "36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:50:52.505197 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.505177 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kserve-provision-location" pod "36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" (UID: "36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:50:52.505276 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.505241 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-cabundle-cert" pod "36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" (UID: "36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:50:52.505276 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.505265 4392 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kserve-provision-location\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:50:52.505381 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.505281 4392 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:50:52.506802 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.506780 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-api-access-vd825" pod "36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" (UID: "36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea"). InnerVolumeSpecName "kube-api-access-vd825". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:50:52.506888 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.506841 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-proxy-tls" pod "36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" (UID: "36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:50:52.606172 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.606098 4392 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-proxy-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:50:52.606172 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.606124 4392 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-cabundle-cert\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:50:52.606172 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:52.606133 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd825\" (UniqueName: \"kubernetes.io/projected/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea-kube-api-access-vd825\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:50:53.057537 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.057495 4392 generic.go:356] "Generic (PLEG): container finished" podID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerID="10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07" exitCode=0 Oct 30 18:50:53.057738 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.057572 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" event={"ID":"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea","Type":"ContainerDied","Data":"10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07"} Oct 30 18:50:53.057738 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.057652 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" event={"ID":"36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea","Type":"ContainerDied","Data":"1517fbdc7c6545e2dec68be2cada1e34a5018389b21f9cd453ee1d880d872133"} Oct 30 18:50:53.057738 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.057584 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb" Oct 30 18:50:53.057866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.057671 4392 scope.go:122] "RemoveContainer" containerID="97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545" Oct 30 18:50:53.066495 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.066479 4392 scope.go:122] "RemoveContainer" containerID="10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07" Oct 30 18:50:53.075284 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.075267 4392 scope.go:122] "RemoveContainer" containerID="15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def" Oct 30 18:50:53.082790 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.082772 4392 scope.go:122] "RemoveContainer" containerID="97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545" Oct 30 18:50:53.083057 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:50:53.083037 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545\": container with ID starting with 97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545 not found: ID does not exist" containerID="97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545" Oct 30 18:50:53.083111 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.083067 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545"} err="failed to get container status \"97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545\": rpc error: code = NotFound desc = could not find container \"97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545\": container with ID starting with 97eb37c83afa5bdcbf1e52e5f8513cba17d2527c32aec2a7af1f903ce5821545 not found: ID does not exist" Oct 30 18:50:53.083111 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.083084 4392 scope.go:122] "RemoveContainer" containerID="10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07" Oct 30 18:50:53.083316 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:50:53.083301 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07\": container with ID starting with 10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07 not found: ID does not exist" containerID="10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07" Oct 30 18:50:53.083357 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.083320 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07"} err="failed to get container status \"10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07\": rpc error: code = NotFound desc = could not find container \"10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07\": container with ID starting with 10e197869395aeed0e9c939ea45a54770f8699ad204223141d7c19543f608a07 not found: ID does not exist" Oct 30 18:50:53.083357 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.083334 4392 scope.go:122] "RemoveContainer" containerID="15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def" Oct 30 18:50:53.083524 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:50:53.083510 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def\": container with ID starting with 15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def not found: ID does not exist" containerID="15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def" Oct 30 18:50:53.083569 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.083527 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def"} err="failed to get container status \"15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def\": rpc error: code = NotFound desc = could not find container \"15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def\": container with ID starting with 15f02c206cfe124e79d93d2ed301c8097062edeeff11076ff0a105e5a3a35def not found: ID does not exist" Oct 30 18:50:53.113928 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.113893 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb"] Oct 30 18:50:53.127572 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.127544 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-v2-predictor-5fdc47fb7c-ld6xb"] Oct 30 18:50:53.785282 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:50:53.785248 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" path="/var/lib/kubelet/pods/36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea/volumes" Oct 30 18:50:53.874261 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:50:53.874228 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:51:23.874997 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:51:23.874959 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:51:53.874178 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:51:53.874140 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:52:23.875091 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:52:23.875043 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:52:28.117978 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:28.117944 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d"] Oct 30 18:52:28.118403 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:28.118197 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" containerID="cri-o://57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c" gracePeriod=30 Oct 30 18:52:28.118403 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:28.118244 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kube-rbac-proxy" containerID="cri-o://f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f" gracePeriod=30 Oct 30 18:52:28.424814 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:28.424776 4392 generic.go:356] "Generic (PLEG): container finished" podID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerID="f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f" exitCode=0 Oct 30 18:52:28.425002 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:28.424854 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" event={"ID":"02c1e68b-c2d8-4459-86ba-ca7059b285b9","Type":"ContainerDied","Data":"f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f"} Oct 30 18:52:31.723838 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:31.723800 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused" Oct 30 18:52:31.728265 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:31.728240 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Oct 30 18:52:33.368136 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.368113 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:52:33.446117 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.446088 4392 generic.go:356] "Generic (PLEG): container finished" podID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerID="57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c" exitCode=0 Oct 30 18:52:33.446293 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.446151 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" Oct 30 18:52:33.446293 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.446161 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" event={"ID":"02c1e68b-c2d8-4459-86ba-ca7059b285b9","Type":"ContainerDied","Data":"57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c"} Oct 30 18:52:33.446293 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.446221 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d" event={"ID":"02c1e68b-c2d8-4459-86ba-ca7059b285b9","Type":"ContainerDied","Data":"be26d20e5520bbb2ba85e4530bf9acdbd8ee042e8c9b110a9932947ae67a99e4"} Oct 30 18:52:33.446293 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.446248 4392 scope.go:122] "RemoveContainer" containerID="f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f" Oct 30 18:52:33.454201 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.454184 4392 scope.go:122] "RemoveContainer" containerID="57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c" Oct 30 18:52:33.461295 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.461277 4392 scope.go:122] "RemoveContainer" containerID="9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f" Oct 30 18:52:33.468238 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.468219 4392 scope.go:122] "RemoveContainer" containerID="f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f" Oct 30 18:52:33.468480 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:52:33.468463 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f\": container with ID starting with f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f not found: ID does not exist" containerID="f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f" Oct 30 18:52:33.468529 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.468488 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f"} err="failed to get container status \"f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f\": rpc error: code = NotFound desc = could not find container \"f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f\": container with ID starting with f45cb6dff943c0cffd9bb6c914e98c6836c8f4bb2d2f2c05c5c4cb3b3c1ed12f not found: ID does not exist" Oct 30 18:52:33.468529 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.468505 4392 scope.go:122] "RemoveContainer" containerID="57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c" Oct 30 18:52:33.468712 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:52:33.468696 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c\": container with ID starting with 57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c not found: ID does not exist" containerID="57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c" Oct 30 18:52:33.468804 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.468716 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c"} err="failed to get container status \"57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c\": rpc error: code = NotFound desc = could not find container \"57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c\": container with ID starting with 57e51a249cb82aa2e4548fbb8b03d45986f0c106d27c1d0a3a8f2f63fc7c0e0c not found: ID does not exist" Oct 30 18:52:33.468804 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.468730 4392 scope.go:122] "RemoveContainer" containerID="9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f" Oct 30 18:52:33.469015 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:52:33.468993 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f\": container with ID starting with 9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f not found: ID does not exist" containerID="9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f" Oct 30 18:52:33.469065 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.469019 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f"} err="failed to get container status \"9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f\": rpc error: code = NotFound desc = could not find container \"9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f\": container with ID starting with 9d5fdb39e53990647fdaa24b1defc7c5a4c4127f79ca75b4c49ca0160241dd1f not found: ID does not exist" Oct 30 18:52:33.475302 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.475282 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-api-access-xfq7j\" (UniqueName: \"kubernetes.io/projected/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-api-access-xfq7j\") pod \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " Oct 30 18:52:33.475365 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.475346 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/02c1e68b-c2d8-4459-86ba-ca7059b285b9-proxy-tls\" (UniqueName: \"kubernetes.io/secret/02c1e68b-c2d8-4459-86ba-ca7059b285b9-proxy-tls\") pod \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " Oct 30 18:52:33.475400 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.475370 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-rbac-proxy-sar-config\") pod \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " Oct 30 18:52:33.475400 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.475388 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kserve-provision-location\") pod \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " Oct 30 18:52:33.475485 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.475431 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-cabundle-cert\") pod \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\" (UID: \"02c1e68b-c2d8-4459-86ba-ca7059b285b9\") " Oct 30 18:52:33.475781 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.475752 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-rbac-proxy-sar-config" pod "02c1e68b-c2d8-4459-86ba-ca7059b285b9" (UID: "02c1e68b-c2d8-4459-86ba-ca7059b285b9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:52:33.475879 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.475763 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kserve-provision-location" pod "02c1e68b-c2d8-4459-86ba-ca7059b285b9" (UID: "02c1e68b-c2d8-4459-86ba-ca7059b285b9"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:52:33.475879 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.475785 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-cabundle-cert" pod "02c1e68b-c2d8-4459-86ba-ca7059b285b9" (UID: "02c1e68b-c2d8-4459-86ba-ca7059b285b9"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:52:33.477322 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.477298 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c1e68b-c2d8-4459-86ba-ca7059b285b9-proxy-tls" pod "02c1e68b-c2d8-4459-86ba-ca7059b285b9" (UID: "02c1e68b-c2d8-4459-86ba-ca7059b285b9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:52:33.477404 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.477375 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-api-access-xfq7j" pod "02c1e68b-c2d8-4459-86ba-ca7059b285b9" (UID: "02c1e68b-c2d8-4459-86ba-ca7059b285b9"). InnerVolumeSpecName "kube-api-access-xfq7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:52:33.576447 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.576410 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfq7j\" (UniqueName: \"kubernetes.io/projected/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-api-access-xfq7j\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:52:33.576447 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.576436 4392 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/02c1e68b-c2d8-4459-86ba-ca7059b285b9-proxy-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:52:33.576447 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.576448 4392 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:52:33.576777 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.576456 4392 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02c1e68b-c2d8-4459-86ba-ca7059b285b9-kserve-provision-location\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:52:33.576777 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.576473 4392 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/02c1e68b-c2d8-4459-86ba-ca7059b285b9-cabundle-cert\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:52:33.795033 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.794998 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d"] Oct 30 18:52:33.808360 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:33.808330 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-rollback-predictor-95869db44-slh7d"] Oct 30 18:52:35.785728 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:35.785691 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" path="/var/lib/kubelet/pods/02c1e68b-c2d8-4459-86ba-ca7059b285b9/volumes" Oct 30 18:52:36.142040 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.141966 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj"] Oct 30 18:52:36.142297 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142283 4392 cpu_manager.go:414] "containerMap: removing container" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" Oct 30 18:52:36.142363 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142297 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" Oct 30 18:52:36.142363 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142310 4392 cpu_manager.go:414] "containerMap: removing container" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kube-rbac-proxy" Oct 30 18:52:36.142363 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142316 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kube-rbac-proxy" Oct 30 18:52:36.142363 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142329 4392 cpu_manager.go:414] "containerMap: removing container" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kube-rbac-proxy" Oct 30 18:52:36.142363 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142335 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kube-rbac-proxy" Oct 30 18:52:36.142363 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142348 4392 cpu_manager.go:414] "containerMap: removing container" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="storage-initializer" Oct 30 18:52:36.142363 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142353 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="storage-initializer" Oct 30 18:52:36.142363 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142361 4392 cpu_manager.go:414] "containerMap: removing container" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="storage-initializer" Oct 30 18:52:36.142363 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142366 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="storage-initializer" Oct 30 18:52:36.142651 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142377 4392 cpu_manager.go:414] "containerMap: removing container" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" Oct 30 18:52:36.142651 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142382 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" Oct 30 18:52:36.142651 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142429 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kserve-container" Oct 30 18:52:36.142651 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142438 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kube-rbac-proxy" Oct 30 18:52:36.142651 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142445 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="02c1e68b-c2d8-4459-86ba-ca7059b285b9" containerName="kube-rbac-proxy" Oct 30 18:52:36.142651 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.142453 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="36abaf9a-7ba3-4c6f-ad68-cefc4c4c5cea" containerName="kserve-container" Oct 30 18:52:36.145740 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.145722 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.176636 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.176608 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 18:52:36.176636 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.176609 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"openshift-service-ca.crt\"" Oct 30 18:52:36.176825 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.176691 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"seaweedfs-s3-creds\"" Oct 30 18:52:36.176825 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.176691 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\"" Oct 30 18:52:36.176825 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.176737 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"kube-root-ca.crt\"" Oct 30 18:52:36.176825 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.176755 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"default-dockercfg-gh4qc\"" Oct 30 18:52:36.176825 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.176795 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d1ae4027ce\"/\"isvc-canary-stop-predictor-serving-cert\"" Oct 30 18:52:36.178085 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.178064 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj"] Oct 30 18:52:36.199807 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.199786 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2j7c\" (UniqueName: \"kubernetes.io/projected/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-api-access-h2j7c\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.199881 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.199816 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.199881 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.199855 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kserve-provision-location\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.199992 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.199974 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-cabundle-cert\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.200027 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.200011 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-proxy-tls\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.301216 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.301177 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2j7c\" (UniqueName: \"kubernetes.io/projected/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-api-access-h2j7c\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.301359 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.301232 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.301359 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.301289 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kserve-provision-location\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.301359 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.301321 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-cabundle-cert\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.301511 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.301373 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-proxy-tls\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.301748 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.301727 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kserve-provision-location\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.301997 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.301978 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.302052 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.302005 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-cabundle-cert\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.303734 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.303715 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-proxy-tls\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.321062 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.321043 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2j7c\" (UniqueName: \"kubernetes.io/projected/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-api-access-h2j7c\") pod \"isvc-canary-stop-predictor-77b4bb9d84-rz7bj\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.462552 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.462524 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:36.774640 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:36.774560 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj"] Oct 30 18:52:36.777927 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:52:36.777887 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7ddab9_54e1_44a4_9524_0a8a6b1ac95a.slice/crio-c1080a897cad4b56e931c4212aa6f1200c64edcd4984ae59ca8d6b1e89a6aa76 WatchSource:0}: Error finding container c1080a897cad4b56e931c4212aa6f1200c64edcd4984ae59ca8d6b1e89a6aa76: Status 404 returned error can't find the container with id c1080a897cad4b56e931c4212aa6f1200c64edcd4984ae59ca8d6b1e89a6aa76 Oct 30 18:52:37.463477 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:37.463439 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" event={"ID":"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a","Type":"ContainerStarted","Data":"8190eced94162544afe66a85c6d35df1ace357b2d60967708e957df730888bf8"} Oct 30 18:52:37.463858 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:37.463501 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" event={"ID":"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a","Type":"ContainerStarted","Data":"c1080a897cad4b56e931c4212aa6f1200c64edcd4984ae59ca8d6b1e89a6aa76"} Oct 30 18:52:41.479920 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:41.479884 4392 generic.go:356] "Generic (PLEG): container finished" podID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerID="8190eced94162544afe66a85c6d35df1ace357b2d60967708e957df730888bf8" exitCode=0 Oct 30 18:52:41.480338 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:41.479968 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" event={"ID":"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a","Type":"ContainerDied","Data":"8190eced94162544afe66a85c6d35df1ace357b2d60967708e957df730888bf8"} Oct 30 18:52:42.485409 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:42.485379 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" event={"ID":"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a","Type":"ContainerStarted","Data":"adf687ee02276d82621e8e9aa374a316052ee62c7a93dd6683d180cc2759b29b"} Oct 30 18:52:42.485795 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:42.485437 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" event={"ID":"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a","Type":"ContainerStarted","Data":"05b4b9def72bf1139ec2f0d6621162f67e9d0b0184a12d1ddca496a18ebfe32f"} Oct 30 18:52:42.485795 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:42.485632 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:42.544924 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:42.544858 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podStartSLOduration=2.7677450869999998 podStartE2EDuration="6.544841461s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.777096374s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:52:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:52:42.542928661 +0000 UTC m=+924.905942027" watchObservedRunningTime="2026-10-30 18:52:42.544841461 +0000 UTC m=+924.907854827" Oct 30 18:52:43.488974 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:43.488936 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:43.490290 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:43.490262 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:52:44.492664 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:44.492614 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:52:49.496812 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:49.496784 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:52:49.497316 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:49.497291 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:52:53.874445 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:52:53.874403 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:52:59.497565 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:52:59.497528 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:53:09.497334 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:09.497256 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:53:19.497452 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:19.497414 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:53:23.875104 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:53:23.875065 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:53:29.497741 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:29.497696 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:53:39.497929 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:39.497873 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:53:43.882778 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.882743 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8"] Oct 30 18:53:43.886451 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.886431 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:43.919595 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.919533 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"openshift-service-ca.crt\"" Oct 30 18:53:43.919595 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.919534 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"isvc-xgboost-graph-raw-hpa-d6eaa-kube-rbac-proxy-sar-config\"" Oct 30 18:53:43.919595 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.919542 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-42351c4657\"/\"seaweedfs-s3-creds\"" Oct 30 18:53:43.919595 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.919569 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-42351c4657\"/\"default-dockercfg-c4gjk\"" Oct 30 18:53:43.919866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.919601 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"kube-root-ca.crt\"" Oct 30 18:53:43.919866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.919614 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 18:53:43.920052 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.920036 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-42351c4657\"/\"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-serving-cert\"" Oct 30 18:53:43.921571 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.921552 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8"] Oct 30 18:53:43.969474 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.969439 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/698ade2c-66b3-4f23-a67d-64a542a989f8-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:43.969668 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.969488 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:43.969668 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.969516 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/698ade2c-66b3-4f23-a67d-64a542a989f8-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:43.969798 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.969664 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:43.969798 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:43.969762 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hdnh\" (UniqueName: \"kubernetes.io/projected/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-api-access-8hdnh\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.070525 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.070486 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.070705 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.070535 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/698ade2c-66b3-4f23-a67d-64a542a989f8-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.070705 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.070654 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.070827 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.070724 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hdnh\" (UniqueName: \"kubernetes.io/projected/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-api-access-8hdnh\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.070827 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.070779 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/698ade2c-66b3-4f23-a67d-64a542a989f8-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.070972 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.070956 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/698ade2c-66b3-4f23-a67d-64a542a989f8-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.071300 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.071279 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.071372 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.071278 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.073215 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.073195 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/698ade2c-66b3-4f23-a67d-64a542a989f8-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.092070 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.092043 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hdnh\" (UniqueName: \"kubernetes.io/projected/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-api-access-8hdnh\") pod \"isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.203811 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.203763 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:53:44.519809 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.519783 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8"] Oct 30 18:53:44.522496 ip-10-0-135-87 kubenswrapper[4392]: W1030 18:53:44.522468 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698ade2c_66b3_4f23_a67d_64a542a989f8.slice/crio-ec132c4c1f019c739393b5d6fdd7b91d1f472d7b799b62ce02fd1caad2cd6074 WatchSource:0}: Error finding container ec132c4c1f019c739393b5d6fdd7b91d1f472d7b799b62ce02fd1caad2cd6074: Status 404 returned error can't find the container with id ec132c4c1f019c739393b5d6fdd7b91d1f472d7b799b62ce02fd1caad2cd6074 Oct 30 18:53:44.724515 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.724473 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" event={"ID":"698ade2c-66b3-4f23-a67d-64a542a989f8","Type":"ContainerStarted","Data":"090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5"} Oct 30 18:53:44.724699 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:44.724553 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" event={"ID":"698ade2c-66b3-4f23-a67d-64a542a989f8","Type":"ContainerStarted","Data":"ec132c4c1f019c739393b5d6fdd7b91d1f472d7b799b62ce02fd1caad2cd6074"} Oct 30 18:53:48.749622 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:48.749582 4392 generic.go:356] "Generic (PLEG): container finished" podID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerID="090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5" exitCode=0 Oct 30 18:53:48.749622 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:48.749621 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" event={"ID":"698ade2c-66b3-4f23-a67d-64a542a989f8","Type":"ContainerDied","Data":"090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5"} Oct 30 18:53:48.751292 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:48.751271 4392 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 18:53:49.497634 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:49.497482 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:53:53.879387 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:53:53.879352 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:53:56.781675 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:53:56.781638 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:54:06.782115 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:06.782077 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:54:07.837849 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:07.837809 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" event={"ID":"698ade2c-66b3-4f23-a67d-64a542a989f8","Type":"ContainerStarted","Data":"b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4"} Oct 30 18:54:07.838280 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:07.837878 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" event={"ID":"698ade2c-66b3-4f23-a67d-64a542a989f8","Type":"ContainerStarted","Data":"f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344"} Oct 30 18:54:07.838280 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:07.838213 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:54:08.841968 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:08.841938 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:54:08.843151 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:08.843122 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Oct 30 18:54:09.845834 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:09.845796 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Oct 30 18:54:14.850375 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:14.850348 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:54:14.850949 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:14.850923 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Oct 30 18:54:14.910954 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:14.910859 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podStartSLOduration=9.564988232 podStartE2EDuration="31.91084244s" totalImagesPullingTime="18.419492336s" totalInitContainerRuntime="3.926361872s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:54:07.896156831 +0000 UTC m=+1010.259170201" watchObservedRunningTime="2026-10-30 18:54:14.91084244 +0000 UTC m=+1017.273855807" Oct 30 18:54:16.130719 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:16.130679 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj"] Oct 30 18:54:16.131187 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:16.130952 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" containerID="cri-o://05b4b9def72bf1139ec2f0d6621162f67e9d0b0184a12d1ddca496a18ebfe32f" gracePeriod=30 Oct 30 18:54:16.131187 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:16.130984 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kube-rbac-proxy" containerID="cri-o://adf687ee02276d82621e8e9aa374a316052ee62c7a93dd6683d180cc2759b29b" gracePeriod=30 Oct 30 18:54:16.781602 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:16.781559 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Oct 30 18:54:16.874760 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:16.874727 4392 generic.go:356] "Generic (PLEG): container finished" podID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerID="adf687ee02276d82621e8e9aa374a316052ee62c7a93dd6683d180cc2759b29b" exitCode=0 Oct 30 18:54:16.874947 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:16.874804 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" event={"ID":"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a","Type":"ContainerDied","Data":"adf687ee02276d82621e8e9aa374a316052ee62c7a93dd6683d180cc2759b29b"} Oct 30 18:54:19.493493 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:19.493441 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.25:8643/healthz\": dial tcp 10.132.0.25:8643: connect: connection refused" Oct 30 18:54:21.897774 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.897740 4392 generic.go:356] "Generic (PLEG): container finished" podID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerID="05b4b9def72bf1139ec2f0d6621162f67e9d0b0184a12d1ddca496a18ebfe32f" exitCode=0 Oct 30 18:54:21.898160 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.897808 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" event={"ID":"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a","Type":"ContainerDied","Data":"05b4b9def72bf1139ec2f0d6621162f67e9d0b0184a12d1ddca496a18ebfe32f"} Oct 30 18:54:21.898160 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.897872 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" event={"ID":"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a","Type":"ContainerDied","Data":"c1080a897cad4b56e931c4212aa6f1200c64edcd4984ae59ca8d6b1e89a6aa76"} Oct 30 18:54:21.898160 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.897895 4392 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1080a897cad4b56e931c4212aa6f1200c64edcd4984ae59ca8d6b1e89a6aa76" Oct 30 18:54:21.947075 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.947040 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:54:21.996528 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.996496 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-rbac-proxy-sar-config\") pod \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " Oct 30 18:54:21.996717 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.996581 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-api-access-h2j7c\" (UniqueName: \"kubernetes.io/projected/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-api-access-h2j7c\") pod \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " Oct 30 18:54:21.996717 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.996625 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kserve-provision-location\") pod \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " Oct 30 18:54:21.996717 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.996653 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-proxy-tls\") pod \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " Oct 30 18:54:21.996866 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.996724 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-cabundle-cert\") pod \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\" (UID: \"5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a\") " Oct 30 18:54:21.997127 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.997100 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-rbac-proxy-sar-config" pod "5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" (UID: "5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:54:21.997216 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.997137 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kserve-provision-location" pod "5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" (UID: "5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:54:21.997216 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.997148 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-cabundle-cert" pod "5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" (UID: "5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:54:21.999074 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.999047 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-proxy-tls" pod "5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" (UID: "5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:54:21.999220 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:21.999205 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-api-access-h2j7c" pod "5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" (UID: "5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a"). InnerVolumeSpecName "kube-api-access-h2j7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:54:22.098265 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:22.098187 4392 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-cabundle-cert\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:54:22.098265 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:22.098218 4392 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:54:22.098265 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:22.098228 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2j7c\" (UniqueName: \"kubernetes.io/projected/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kube-api-access-h2j7c\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:54:22.098265 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:22.098237 4392 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-kserve-provision-location\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:54:22.098265 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:22.098246 4392 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a-proxy-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:54:22.902178 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:22.902151 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj" Oct 30 18:54:22.971521 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:22.971485 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj"] Oct 30 18:54:22.984670 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:22.984630 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d1ae4027ce/isvc-canary-stop-predictor-77b4bb9d84-rz7bj"] Oct 30 18:54:23.786146 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:23.786112 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" path="/var/lib/kubelet/pods/5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a/volumes" Oct 30 18:54:23.875891 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:54:23.875854 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:54:24.851141 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:24.851101 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Oct 30 18:54:34.851443 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:34.851357 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Oct 30 18:54:44.851709 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:44.851666 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Oct 30 18:54:53.875928 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:54:53.875872 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:54:54.851119 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:54:54.851078 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Oct 30 18:55:04.851652 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:04.851604 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Oct 30 18:55:14.851313 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:14.851273 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Oct 30 18:55:23.875153 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:55:23.875112 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:55:24.852063 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:24.852029 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:55:44.202655 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:44.202622 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8"] Oct 30 18:55:44.203111 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:44.202868 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" containerID="cri-o://f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344" gracePeriod=30 Oct 30 18:55:44.203111 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:44.202980 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kube-rbac-proxy" containerID="cri-o://b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4" gracePeriod=30 Oct 30 18:55:44.846503 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:44.846453 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.26:8643/healthz\": dial tcp 10.132.0.26:8643: connect: connection refused" Oct 30 18:55:44.850963 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:44.850938 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Oct 30 18:55:45.227486 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:45.227448 4392 generic.go:356] "Generic (PLEG): container finished" podID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerID="b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4" exitCode=0 Oct 30 18:55:45.227869 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:45.227512 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" event={"ID":"698ade2c-66b3-4f23-a67d-64a542a989f8","Type":"ContainerDied","Data":"b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4"} Oct 30 18:55:48.541250 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.541222 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:55:48.657433 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.657346 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-api-access-8hdnh\" (UniqueName: \"kubernetes.io/projected/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-api-access-8hdnh\") pod \"698ade2c-66b3-4f23-a67d-64a542a989f8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " Oct 30 18:55:48.657433 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.657414 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-rbac-proxy-sar-config\") pod \"698ade2c-66b3-4f23-a67d-64a542a989f8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " Oct 30 18:55:48.657677 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.657450 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-cabundle-cert\") pod \"698ade2c-66b3-4f23-a67d-64a542a989f8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " Oct 30 18:55:48.657677 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.657485 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/698ade2c-66b3-4f23-a67d-64a542a989f8-proxy-tls\" (UniqueName: \"kubernetes.io/secret/698ade2c-66b3-4f23-a67d-64a542a989f8-proxy-tls\") pod \"698ade2c-66b3-4f23-a67d-64a542a989f8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " Oct 30 18:55:48.657677 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.657624 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/698ade2c-66b3-4f23-a67d-64a542a989f8-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/698ade2c-66b3-4f23-a67d-64a542a989f8-kserve-provision-location\") pod \"698ade2c-66b3-4f23-a67d-64a542a989f8\" (UID: \"698ade2c-66b3-4f23-a67d-64a542a989f8\") " Oct 30 18:55:48.657973 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.657939 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-rbac-proxy-sar-config" pod "698ade2c-66b3-4f23-a67d-64a542a989f8" (UID: "698ade2c-66b3-4f23-a67d-64a542a989f8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:55:48.657973 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.657950 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-cabundle-cert" pod "698ade2c-66b3-4f23-a67d-64a542a989f8" (UID: "698ade2c-66b3-4f23-a67d-64a542a989f8"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:55:48.658149 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.657950 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698ade2c-66b3-4f23-a67d-64a542a989f8-kserve-provision-location" pod "698ade2c-66b3-4f23-a67d-64a542a989f8" (UID: "698ade2c-66b3-4f23-a67d-64a542a989f8"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:55:48.660277 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.660253 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-api-access-8hdnh" pod "698ade2c-66b3-4f23-a67d-64a542a989f8" (UID: "698ade2c-66b3-4f23-a67d-64a542a989f8"). InnerVolumeSpecName "kube-api-access-8hdnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:55:48.660373 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.660291 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/698ade2c-66b3-4f23-a67d-64a542a989f8-proxy-tls" pod "698ade2c-66b3-4f23-a67d-64a542a989f8" (UID: "698ade2c-66b3-4f23-a67d-64a542a989f8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:55:48.759210 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.759169 4392 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-cabundle-cert\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:55:48.759210 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.759203 4392 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/698ade2c-66b3-4f23-a67d-64a542a989f8-proxy-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:55:48.759210 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.759212 4392 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/698ade2c-66b3-4f23-a67d-64a542a989f8-kserve-provision-location\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:55:48.759440 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.759224 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hdnh\" (UniqueName: \"kubernetes.io/projected/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-api-access-8hdnh\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:55:48.759440 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:48.759233 4392 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/698ade2c-66b3-4f23-a67d-64a542a989f8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 18:55:49.244839 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.244800 4392 generic.go:356] "Generic (PLEG): container finished" podID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerID="f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344" exitCode=0 Oct 30 18:55:49.245069 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.244865 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" event={"ID":"698ade2c-66b3-4f23-a67d-64a542a989f8","Type":"ContainerDied","Data":"f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344"} Oct 30 18:55:49.245069 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.244868 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" Oct 30 18:55:49.245069 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.244932 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8" event={"ID":"698ade2c-66b3-4f23-a67d-64a542a989f8","Type":"ContainerDied","Data":"ec132c4c1f019c739393b5d6fdd7b91d1f472d7b799b62ce02fd1caad2cd6074"} Oct 30 18:55:49.245069 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.244958 4392 scope.go:122] "RemoveContainer" containerID="b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4" Oct 30 18:55:49.253849 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.253828 4392 scope.go:122] "RemoveContainer" containerID="f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344" Oct 30 18:55:49.260921 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.260890 4392 scope.go:122] "RemoveContainer" containerID="090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5" Oct 30 18:55:49.267683 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.267668 4392 scope.go:122] "RemoveContainer" containerID="b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4" Oct 30 18:55:49.267959 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:55:49.267895 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4\": container with ID starting with b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4 not found: ID does not exist" containerID="b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4" Oct 30 18:55:49.268044 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.267944 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4"} err="failed to get container status \"b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4\": rpc error: code = NotFound desc = could not find container \"b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4\": container with ID starting with b9b95ad5e52aee7a736e38ccbe5bf332f8d50c54453b41f62978068af24776b4 not found: ID does not exist" Oct 30 18:55:49.268044 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.267972 4392 scope.go:122] "RemoveContainer" containerID="f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344" Oct 30 18:55:49.268262 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:55:49.268243 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344\": container with ID starting with f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344 not found: ID does not exist" containerID="f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344" Oct 30 18:55:49.268298 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.268268 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344"} err="failed to get container status \"f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344\": rpc error: code = NotFound desc = could not find container \"f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344\": container with ID starting with f17849eb986447c634139863b1866e7ad94761e48573c754e1d3c26cceaef344 not found: ID does not exist" Oct 30 18:55:49.268298 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.268285 4392 scope.go:122] "RemoveContainer" containerID="090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5" Oct 30 18:55:49.270794 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:55:49.269072 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5\": container with ID starting with 090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5 not found: ID does not exist" containerID="090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5" Oct 30 18:55:49.270794 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.269138 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5"} err="failed to get container status \"090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5\": rpc error: code = NotFound desc = could not find container \"090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5\": container with ID starting with 090c12ff66ae1ed191c75efe51788f07790c440f18f84eb0d15b1653be115fc5 not found: ID does not exist" Oct 30 18:55:49.313604 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.313561 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8"] Oct 30 18:55:49.326883 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.326845 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-42351c4657/isvc-xgboost-graph-raw-hpa-d6eaa-predictor-59569bb8c9-bnpf8"] Oct 30 18:55:49.785685 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:55:49.785646 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" path="/var/lib/kubelet/pods/698ade2c-66b3-4f23-a67d-64a542a989f8/volumes" Oct 30 18:55:53.875117 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:55:53.875083 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:56:23.874780 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:56:23.874736 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:56:53.875746 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:56:53.875709 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:57:23.877092 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:57:23.876979 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:57:53.876759 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:57:53.876702 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:58:23.878348 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:58:23.878306 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:58:53.875463 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:58:53.875424 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:59:17.902474 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:59:17.902395 4392 scope.go:122] "RemoveContainer" containerID="adf687ee02276d82621e8e9aa374a316052ee62c7a93dd6683d180cc2759b29b" Oct 30 18:59:17.911246 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:59:17.911221 4392 scope.go:122] "RemoveContainer" containerID="05b4b9def72bf1139ec2f0d6621162f67e9d0b0184a12d1ddca496a18ebfe32f" Oct 30 18:59:17.919477 ip-10-0-135-87 kubenswrapper[4392]: I1030 18:59:17.919456 4392 scope.go:122] "RemoveContainer" containerID="8190eced94162544afe66a85c6d35df1ace357b2d60967708e957df730888bf8" Oct 30 18:59:23.875295 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:59:23.875256 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 18:59:53.875488 ip-10-0-135-87 kubenswrapper[4392]: E1030 18:59:53.875442 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:00:23.874068 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:00:23.874016 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:00:53.874268 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:00:53.874190 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:01:23.874351 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:01:23.874305 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:01:45.109716 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.109680 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc"] Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110054 4392 cpu_manager.go:414] "containerMap: removing container" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="storage-initializer" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110067 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="storage-initializer" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110075 4392 cpu_manager.go:414] "containerMap: removing container" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110080 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110088 4392 cpu_manager.go:414] "containerMap: removing container" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kube-rbac-proxy" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110094 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kube-rbac-proxy" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110109 4392 cpu_manager.go:414] "containerMap: removing container" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="storage-initializer" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110114 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="storage-initializer" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110120 4392 cpu_manager.go:414] "containerMap: removing container" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110125 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110135 4392 cpu_manager.go:414] "containerMap: removing container" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kube-rbac-proxy" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110139 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kube-rbac-proxy" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110182 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kube-rbac-proxy" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110189 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kserve-container" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110197 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="698ade2c-66b3-4f23-a67d-64a542a989f8" containerName="kserve-container" Oct 30 19:01:45.110212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.110203 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f7ddab9-54e1-44a4-9524-0a8a6b1ac95a" containerName="kube-rbac-proxy" Oct 30 19:01:45.113483 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.113465 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.126398 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.126374 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/070f4a8b-813c-4928-86ad-f27a0250af61-proxy-tls\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.126503 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.126410 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drfzv\" (UniqueName: \"kubernetes.io/projected/070f4a8b-813c-4928-86ad-f27a0250af61-kube-api-access-drfzv\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.126503 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.126441 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/070f4a8b-813c-4928-86ad-f27a0250af61-kserve-provision-location\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.126596 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.126578 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-cabundle-cert\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.126632 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.126606 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.130374 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.130352 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 19:01:45.130374 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.130357 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\"" Oct 30 19:01:45.132764 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.132748 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"kube-root-ca.crt\"" Oct 30 19:01:45.133048 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.133031 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"openshift-service-ca.crt\"" Oct 30 19:01:45.144484 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.144465 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-42351c4657\"/\"isvc-canary-create-predictor-serving-cert\"" Oct 30 19:01:45.146313 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.146289 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-42351c4657\"/\"seaweedfs-s3-creds\"" Oct 30 19:01:45.146438 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.146289 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-42351c4657\"/\"default-dockercfg-c4gjk\"" Oct 30 19:01:45.148023 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.148004 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc"] Oct 30 19:01:45.227360 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.227331 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drfzv\" (UniqueName: \"kubernetes.io/projected/070f4a8b-813c-4928-86ad-f27a0250af61-kube-api-access-drfzv\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.227529 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.227378 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/070f4a8b-813c-4928-86ad-f27a0250af61-kserve-provision-location\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.227529 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.227450 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-cabundle-cert\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.227529 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.227474 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.227529 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.227512 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/070f4a8b-813c-4928-86ad-f27a0250af61-proxy-tls\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.227839 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.227819 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/070f4a8b-813c-4928-86ad-f27a0250af61-kserve-provision-location\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.228371 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.228350 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-cabundle-cert\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.228428 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.228359 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.229978 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.229952 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/070f4a8b-813c-4928-86ad-f27a0250af61-proxy-tls\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.247828 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.247806 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drfzv\" (UniqueName: \"kubernetes.io/projected/070f4a8b-813c-4928-86ad-f27a0250af61-kube-api-access-drfzv\") pod \"isvc-canary-create-predictor-6c4b8d6c8c-bq2bc\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.431148 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.431111 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:45.744747 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:45.744719 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc"] Oct 30 19:01:45.747583 ip-10-0-135-87 kubenswrapper[4392]: W1030 19:01:45.747550 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070f4a8b_813c_4928_86ad_f27a0250af61.slice/crio-07963da4090389f76c9c3e9854a44950a5623e1bf90c7124a0a3fec15b3c529a WatchSource:0}: Error finding container 07963da4090389f76c9c3e9854a44950a5623e1bf90c7124a0a3fec15b3c529a: Status 404 returned error can't find the container with id 07963da4090389f76c9c3e9854a44950a5623e1bf90c7124a0a3fec15b3c529a Oct 30 19:01:46.645722 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:46.645680 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" event={"ID":"070f4a8b-813c-4928-86ad-f27a0250af61","Type":"ContainerStarted","Data":"5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619"} Oct 30 19:01:46.646146 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:46.645735 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" event={"ID":"070f4a8b-813c-4928-86ad-f27a0250af61","Type":"ContainerStarted","Data":"07963da4090389f76c9c3e9854a44950a5623e1bf90c7124a0a3fec15b3c529a"} Oct 30 19:01:49.658175 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:49.658136 4392 generic.go:356] "Generic (PLEG): container finished" podID="070f4a8b-813c-4928-86ad-f27a0250af61" containerID="5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619" exitCode=0 Oct 30 19:01:49.658555 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:49.658210 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" event={"ID":"070f4a8b-813c-4928-86ad-f27a0250af61","Type":"ContainerDied","Data":"5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619"} Oct 30 19:01:50.663830 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:50.663790 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" event={"ID":"070f4a8b-813c-4928-86ad-f27a0250af61","Type":"ContainerStarted","Data":"4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001"} Oct 30 19:01:50.664336 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:50.663858 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" event={"ID":"070f4a8b-813c-4928-86ad-f27a0250af61","Type":"ContainerStarted","Data":"3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be"} Oct 30 19:01:50.664336 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:50.664053 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:50.727023 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:50.726956 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podStartSLOduration=1.950840701 podStartE2EDuration="5.726939151s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.77609845s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:01:50.725788333 +0000 UTC m=+1473.088801699" watchObservedRunningTime="2026-10-30 19:01:50.726939151 +0000 UTC m=+1473.089952518" Oct 30 19:01:51.668051 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:51.668010 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:51.669466 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:51.669435 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Oct 30 19:01:52.671924 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:52.671866 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Oct 30 19:01:53.877738 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:01:53.877702 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:01:57.676434 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:57.676401 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:01:57.677044 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:01:57.677015 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Oct 30 19:02:07.677023 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:02:07.676923 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Oct 30 19:02:17.677149 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:02:17.677041 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Oct 30 19:02:23.875274 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:02:23.875234 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:02:27.677145 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:02:27.677105 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Oct 30 19:02:37.677361 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:02:37.677312 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Oct 30 19:02:47.677665 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:02:47.677624 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Oct 30 19:02:53.875785 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:02:53.875741 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:02:57.677383 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:02:57.677344 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Oct 30 19:03:07.677440 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:07.677404 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Oct 30 19:03:12.838299 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:12.838263 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc"] Oct 30 19:03:12.838743 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:12.838497 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" containerID="cri-o://3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be" gracePeriod=30 Oct 30 19:03:12.838743 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:12.838571 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kube-rbac-proxy" containerID="cri-o://4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001" gracePeriod=30 Oct 30 19:03:12.839441 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:12.839419 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:03:12.988895 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:12.988856 4392 generic.go:356] "Generic (PLEG): container finished" podID="070f4a8b-813c-4928-86ad-f27a0250af61" containerID="4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001" exitCode=0 Oct 30 19:03:12.989144 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:12.988942 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" event={"ID":"070f4a8b-813c-4928-86ad-f27a0250af61","Type":"ContainerDied","Data":"4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001"} Oct 30 19:03:17.672166 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:17.672116 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.27:8643/healthz\": dial tcp 10.132.0.27:8643: connect: connection refused" Oct 30 19:03:17.985698 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:17.985670 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:03:18.010072 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.010038 4392 generic.go:356] "Generic (PLEG): container finished" podID="070f4a8b-813c-4928-86ad-f27a0250af61" containerID="3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be" exitCode=0 Oct 30 19:03:18.010307 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.010097 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" Oct 30 19:03:18.010307 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.010119 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" event={"ID":"070f4a8b-813c-4928-86ad-f27a0250af61","Type":"ContainerDied","Data":"3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be"} Oct 30 19:03:18.010307 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.010181 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc" event={"ID":"070f4a8b-813c-4928-86ad-f27a0250af61","Type":"ContainerDied","Data":"07963da4090389f76c9c3e9854a44950a5623e1bf90c7124a0a3fec15b3c529a"} Oct 30 19:03:18.010307 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.010209 4392 scope.go:122] "RemoveContainer" containerID="4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001" Oct 30 19:03:18.018975 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.018960 4392 scope.go:122] "RemoveContainer" containerID="3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be" Oct 30 19:03:18.029510 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.028930 4392 scope.go:122] "RemoveContainer" containerID="5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619" Oct 30 19:03:18.036652 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.036635 4392 scope.go:122] "RemoveContainer" containerID="4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001" Oct 30 19:03:18.036942 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:03:18.036924 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001\": container with ID starting with 4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001 not found: ID does not exist" containerID="4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001" Oct 30 19:03:18.037017 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.036952 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001"} err="failed to get container status \"4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001\": rpc error: code = NotFound desc = could not find container \"4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001\": container with ID starting with 4f62062bf1cab1450f31299758cf7c026c008b9545695fc90324c62361147001 not found: ID does not exist" Oct 30 19:03:18.037017 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.036969 4392 scope.go:122] "RemoveContainer" containerID="3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be" Oct 30 19:03:18.037226 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:03:18.037209 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be\": container with ID starting with 3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be not found: ID does not exist" containerID="3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be" Oct 30 19:03:18.037274 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.037231 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be"} err="failed to get container status \"3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be\": rpc error: code = NotFound desc = could not find container \"3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be\": container with ID starting with 3b76279842ac75f079fb7b58bd75075ab5c3de800c7174ce2469cb68e76109be not found: ID does not exist" Oct 30 19:03:18.037274 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.037246 4392 scope.go:122] "RemoveContainer" containerID="5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619" Oct 30 19:03:18.037474 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:03:18.037455 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619\": container with ID starting with 5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619 not found: ID does not exist" containerID="5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619" Oct 30 19:03:18.037511 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.037481 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619"} err="failed to get container status \"5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619\": rpc error: code = NotFound desc = could not find container \"5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619\": container with ID starting with 5aa0444b3d8dee5c71e1dd0dabb6626c3cc48376bf0af3715438c18dc4cd3619 not found: ID does not exist" Oct 30 19:03:18.127174 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.127134 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/070f4a8b-813c-4928-86ad-f27a0250af61-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/070f4a8b-813c-4928-86ad-f27a0250af61-kserve-provision-location\") pod \"070f4a8b-813c-4928-86ad-f27a0250af61\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " Oct 30 19:03:18.127394 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.127196 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/070f4a8b-813c-4928-86ad-f27a0250af61-proxy-tls\" (UniqueName: \"kubernetes.io/secret/070f4a8b-813c-4928-86ad-f27a0250af61-proxy-tls\") pod \"070f4a8b-813c-4928-86ad-f27a0250af61\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " Oct 30 19:03:18.127394 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.127238 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/070f4a8b-813c-4928-86ad-f27a0250af61-kube-api-access-drfzv\" (UniqueName: \"kubernetes.io/projected/070f4a8b-813c-4928-86ad-f27a0250af61-kube-api-access-drfzv\") pod \"070f4a8b-813c-4928-86ad-f27a0250af61\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " Oct 30 19:03:18.127394 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.127375 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-cabundle-cert\") pod \"070f4a8b-813c-4928-86ad-f27a0250af61\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " Oct 30 19:03:18.127562 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.127416 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-kube-rbac-proxy-sar-config\") pod \"070f4a8b-813c-4928-86ad-f27a0250af61\" (UID: \"070f4a8b-813c-4928-86ad-f27a0250af61\") " Oct 30 19:03:18.127562 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.127483 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/070f4a8b-813c-4928-86ad-f27a0250af61-kserve-provision-location" pod "070f4a8b-813c-4928-86ad-f27a0250af61" (UID: "070f4a8b-813c-4928-86ad-f27a0250af61"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 19:03:18.127784 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.127757 4392 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/070f4a8b-813c-4928-86ad-f27a0250af61-kserve-provision-location\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:03:18.127923 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.127798 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-cabundle-cert" pod "070f4a8b-813c-4928-86ad-f27a0250af61" (UID: "070f4a8b-813c-4928-86ad-f27a0250af61"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:03:18.127923 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.127813 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-kube-rbac-proxy-sar-config" pod "070f4a8b-813c-4928-86ad-f27a0250af61" (UID: "070f4a8b-813c-4928-86ad-f27a0250af61"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:03:18.129375 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.129354 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/070f4a8b-813c-4928-86ad-f27a0250af61-kube-api-access-drfzv" pod "070f4a8b-813c-4928-86ad-f27a0250af61" (UID: "070f4a8b-813c-4928-86ad-f27a0250af61"). InnerVolumeSpecName "kube-api-access-drfzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:03:18.129464 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.129444 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/070f4a8b-813c-4928-86ad-f27a0250af61-proxy-tls" pod "070f4a8b-813c-4928-86ad-f27a0250af61" (UID: "070f4a8b-813c-4928-86ad-f27a0250af61"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:03:18.228626 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.228536 4392 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/070f4a8b-813c-4928-86ad-f27a0250af61-proxy-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:03:18.228626 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.228569 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drfzv\" (UniqueName: \"kubernetes.io/projected/070f4a8b-813c-4928-86ad-f27a0250af61-kube-api-access-drfzv\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:03:18.228626 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.228582 4392 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-cabundle-cert\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:03:18.228626 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.228591 4392 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/070f4a8b-813c-4928-86ad-f27a0250af61-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:03:18.356767 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.356734 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc"] Oct 30 19:03:18.360024 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:18.360001 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-create-predictor-6c4b8d6c8c-bq2bc"] Oct 30 19:03:19.785203 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:19.785170 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" path="/var/lib/kubelet/pods/070f4a8b-813c-4928-86ad-f27a0250af61/volumes" Oct 30 19:03:23.875093 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:03:23.875056 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:03:32.989466 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:32.989384 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6"] Oct 30 19:03:32.989974 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:32.989713 4392 cpu_manager.go:414] "containerMap: removing container" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kube-rbac-proxy" Oct 30 19:03:32.989974 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:32.989725 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kube-rbac-proxy" Oct 30 19:03:32.989974 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:32.989760 4392 cpu_manager.go:414] "containerMap: removing container" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="storage-initializer" Oct 30 19:03:32.989974 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:32.989765 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="storage-initializer" Oct 30 19:03:32.989974 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:32.989772 4392 cpu_manager.go:414] "containerMap: removing container" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" Oct 30 19:03:32.989974 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:32.989777 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" Oct 30 19:03:32.989974 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:32.989825 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kube-rbac-proxy" Oct 30 19:03:32.989974 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:32.989833 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="070f4a8b-813c-4928-86ad-f27a0250af61" containerName="kserve-container" Oct 30 19:03:32.994636 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:32.994613 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.011986 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.011954 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 19:03:33.025314 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.025288 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"openshift-service-ca.crt\"" Oct 30 19:03:33.025314 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.025320 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\"" Oct 30 19:03:33.025519 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.025382 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-42351c4657\"/\"kube-root-ca.crt\"" Oct 30 19:03:33.026731 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.026710 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6"] Oct 30 19:03:33.037813 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.037789 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-42351c4657\"/\"default-dockercfg-c4gjk\"" Oct 30 19:03:33.037813 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.037790 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-42351c4657\"/\"seaweedfs-s3-creds\"" Oct 30 19:03:33.037813 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.037811 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-42351c4657\"/\"isvc-canary-promote-predictor-serving-cert\"" Oct 30 19:03:33.045127 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.045106 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.045187 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.045137 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/348f0982-513c-49f7-b9cb-532f0d31063f-proxy-tls\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.045187 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.045170 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zwdt\" (UniqueName: \"kubernetes.io/projected/348f0982-513c-49f7-b9cb-532f0d31063f-kube-api-access-4zwdt\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.045257 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.045238 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/348f0982-513c-49f7-b9cb-532f0d31063f-kserve-provision-location\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.045290 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.045280 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-cabundle-cert\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.146145 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.146109 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.146145 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.146147 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/348f0982-513c-49f7-b9cb-532f0d31063f-proxy-tls\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.146411 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.146198 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zwdt\" (UniqueName: \"kubernetes.io/projected/348f0982-513c-49f7-b9cb-532f0d31063f-kube-api-access-4zwdt\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.146411 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.146220 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/348f0982-513c-49f7-b9cb-532f0d31063f-kserve-provision-location\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.146411 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.146249 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-cabundle-cert\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.146703 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.146680 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/348f0982-513c-49f7-b9cb-532f0d31063f-kserve-provision-location\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.146841 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.146819 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.146888 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.146865 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-cabundle-cert\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.148662 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.148636 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/348f0982-513c-49f7-b9cb-532f0d31063f-proxy-tls\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.169884 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.169856 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zwdt\" (UniqueName: \"kubernetes.io/projected/348f0982-513c-49f7-b9cb-532f0d31063f-kube-api-access-4zwdt\") pod \"isvc-canary-promote-predictor-b9c5956c9-55tm6\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.311991 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.311866 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:33.626688 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:33.626607 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6"] Oct 30 19:03:33.630249 ip-10-0-135-87 kubenswrapper[4392]: W1030 19:03:33.630212 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348f0982_513c_49f7_b9cb_532f0d31063f.slice/crio-bf7845afd7c51aaec49faef89a5c9e3223962f1d8495fa83a9763f38ab10d015 WatchSource:0}: Error finding container bf7845afd7c51aaec49faef89a5c9e3223962f1d8495fa83a9763f38ab10d015: Status 404 returned error can't find the container with id bf7845afd7c51aaec49faef89a5c9e3223962f1d8495fa83a9763f38ab10d015 Oct 30 19:03:34.076360 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:34.076323 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" event={"ID":"348f0982-513c-49f7-b9cb-532f0d31063f","Type":"ContainerStarted","Data":"d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077"} Oct 30 19:03:34.076867 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:34.076383 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" event={"ID":"348f0982-513c-49f7-b9cb-532f0d31063f","Type":"ContainerStarted","Data":"bf7845afd7c51aaec49faef89a5c9e3223962f1d8495fa83a9763f38ab10d015"} Oct 30 19:03:38.093249 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:38.093213 4392 generic.go:356] "Generic (PLEG): container finished" podID="348f0982-513c-49f7-b9cb-532f0d31063f" containerID="d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077" exitCode=0 Oct 30 19:03:38.093670 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:38.093284 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" event={"ID":"348f0982-513c-49f7-b9cb-532f0d31063f","Type":"ContainerDied","Data":"d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077"} Oct 30 19:03:39.099150 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:39.099112 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" event={"ID":"348f0982-513c-49f7-b9cb-532f0d31063f","Type":"ContainerStarted","Data":"8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580"} Oct 30 19:03:39.099659 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:39.099200 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" event={"ID":"348f0982-513c-49f7-b9cb-532f0d31063f","Type":"ContainerStarted","Data":"6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346"} Oct 30 19:03:39.099659 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:39.099443 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:39.158104 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:39.158015 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podStartSLOduration=3.3953614 podStartE2EDuration="7.157995605s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.762634205s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:03:39.157432755 +0000 UTC m=+1581.520446121" watchObservedRunningTime="2026-10-30 19:03:39.157995605 +0000 UTC m=+1581.521008972" Oct 30 19:03:40.102977 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:40.102941 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:40.104295 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:40.104262 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused" Oct 30 19:03:41.107571 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:41.107527 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused" Oct 30 19:03:46.112737 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:46.112702 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:03:46.113250 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:46.113224 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused" Oct 30 19:03:53.876354 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:03:53.876312 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:03:56.113145 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:03:56.113107 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused" Oct 30 19:04:06.113975 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:04:06.113928 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused" Oct 30 19:04:16.113199 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:04:16.113149 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused" Oct 30 19:04:23.876030 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:04:23.875988 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:04:26.113449 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:04:26.113410 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused" Oct 30 19:04:36.114124 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:04:36.114080 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused" Oct 30 19:04:46.113518 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:04:46.113475 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused" Oct 30 19:04:53.875059 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:04:53.875017 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:04:56.114002 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:04:56.113957 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused" Oct 30 19:05:00.782136 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:00.782061 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:05:00.895212 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:00.895182 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6"] Oct 30 19:05:02.424631 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:02.424580 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" containerID="cri-o://6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346" gracePeriod=30 Oct 30 19:05:02.424631 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:02.424599 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kube-rbac-proxy" containerID="cri-o://8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580" gracePeriod=30 Oct 30 19:05:03.230238 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.230197 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn"] Oct 30 19:05:03.234689 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.234669 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.255851 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.255822 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn"] Oct 30 19:05:03.267330 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.267306 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-42351c4657\"/\"isvc-canary-promote-v2-predictor-serving-cert\"" Oct 30 19:05:03.326328 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.326290 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/951a2ed6-d17e-4779-a45e-7876541473b3-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.326328 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.326332 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/951a2ed6-d17e-4779-a45e-7876541473b3-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.326545 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.326433 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22tbw\" (UniqueName: \"kubernetes.io/projected/951a2ed6-d17e-4779-a45e-7876541473b3-kube-api-access-22tbw\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.326545 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.326470 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.326545 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.326500 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.427563 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.427524 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/951a2ed6-d17e-4779-a45e-7876541473b3-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.427563 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.427566 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/951a2ed6-d17e-4779-a45e-7876541473b3-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.428098 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.427621 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22tbw\" (UniqueName: \"kubernetes.io/projected/951a2ed6-d17e-4779-a45e-7876541473b3-kube-api-access-22tbw\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.428098 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.427660 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.428098 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.427696 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.428218 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.428130 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/951a2ed6-d17e-4779-a45e-7876541473b3-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.428521 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.428497 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.428579 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.428504 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.430437 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.430412 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/951a2ed6-d17e-4779-a45e-7876541473b3-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.431782 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.431759 4392 generic.go:356] "Generic (PLEG): container finished" podID="348f0982-513c-49f7-b9cb-532f0d31063f" containerID="8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580" exitCode=0 Oct 30 19:05:03.431881 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.431831 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" event={"ID":"348f0982-513c-49f7-b9cb-532f0d31063f","Type":"ContainerDied","Data":"8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580"} Oct 30 19:05:03.449881 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.449854 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22tbw\" (UniqueName: \"kubernetes.io/projected/951a2ed6-d17e-4779-a45e-7876541473b3-kube-api-access-22tbw\") pod \"isvc-canary-promote-v2-predictor-dc54999c4-ghxkn\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.552535 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.552448 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:03.870006 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:03.869980 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn"] Oct 30 19:05:03.872720 ip-10-0-135-87 kubenswrapper[4392]: W1030 19:05:03.872687 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951a2ed6_d17e_4779_a45e_7876541473b3.slice/crio-9fb1f288cbeb36f4d304a295084bd8523b42bb6eed6d7b567014a49cd21e21b4 WatchSource:0}: Error finding container 9fb1f288cbeb36f4d304a295084bd8523b42bb6eed6d7b567014a49cd21e21b4: Status 404 returned error can't find the container with id 9fb1f288cbeb36f4d304a295084bd8523b42bb6eed6d7b567014a49cd21e21b4 Oct 30 19:05:04.438501 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:04.438467 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" event={"ID":"951a2ed6-d17e-4779-a45e-7876541473b3","Type":"ContainerStarted","Data":"765b129daf41c961e425c323f61e68b58aaa4decd3bd77101ce42962f0207bfe"} Oct 30 19:05:04.439030 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:04.438543 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" event={"ID":"951a2ed6-d17e-4779-a45e-7876541473b3","Type":"ContainerStarted","Data":"9fb1f288cbeb36f4d304a295084bd8523b42bb6eed6d7b567014a49cd21e21b4"} Oct 30 19:05:06.108111 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:06.108061 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.28:8643/healthz\": dial tcp 10.132.0.28:8643: connect: connection refused" Oct 30 19:05:07.718143 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.718117 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:05:07.869351 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.869313 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/348f0982-513c-49f7-b9cb-532f0d31063f-kube-api-access-4zwdt\" (UniqueName: \"kubernetes.io/projected/348f0982-513c-49f7-b9cb-532f0d31063f-kube-api-access-4zwdt\") pod \"348f0982-513c-49f7-b9cb-532f0d31063f\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " Oct 30 19:05:07.869351 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.869357 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-cabundle-cert\") pod \"348f0982-513c-49f7-b9cb-532f0d31063f\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " Oct 30 19:05:07.869630 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.869401 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/348f0982-513c-49f7-b9cb-532f0d31063f-proxy-tls\" (UniqueName: \"kubernetes.io/secret/348f0982-513c-49f7-b9cb-532f0d31063f-proxy-tls\") pod \"348f0982-513c-49f7-b9cb-532f0d31063f\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " Oct 30 19:05:07.869630 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.869447 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/348f0982-513c-49f7-b9cb-532f0d31063f-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/348f0982-513c-49f7-b9cb-532f0d31063f-kserve-provision-location\") pod \"348f0982-513c-49f7-b9cb-532f0d31063f\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " Oct 30 19:05:07.869630 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.869553 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-kube-rbac-proxy-sar-config\") pod \"348f0982-513c-49f7-b9cb-532f0d31063f\" (UID: \"348f0982-513c-49f7-b9cb-532f0d31063f\") " Oct 30 19:05:07.869902 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.869871 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/348f0982-513c-49f7-b9cb-532f0d31063f-kserve-provision-location" pod "348f0982-513c-49f7-b9cb-532f0d31063f" (UID: "348f0982-513c-49f7-b9cb-532f0d31063f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 19:05:07.870047 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.869930 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-cabundle-cert" pod "348f0982-513c-49f7-b9cb-532f0d31063f" (UID: "348f0982-513c-49f7-b9cb-532f0d31063f"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:05:07.870047 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.870031 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-kube-rbac-proxy-sar-config" pod "348f0982-513c-49f7-b9cb-532f0d31063f" (UID: "348f0982-513c-49f7-b9cb-532f0d31063f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:05:07.871614 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.871592 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/348f0982-513c-49f7-b9cb-532f0d31063f-proxy-tls" pod "348f0982-513c-49f7-b9cb-532f0d31063f" (UID: "348f0982-513c-49f7-b9cb-532f0d31063f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:05:07.871714 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.871652 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/348f0982-513c-49f7-b9cb-532f0d31063f-kube-api-access-4zwdt" pod "348f0982-513c-49f7-b9cb-532f0d31063f" (UID: "348f0982-513c-49f7-b9cb-532f0d31063f"). InnerVolumeSpecName "kube-api-access-4zwdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:05:07.971280 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.971193 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zwdt\" (UniqueName: \"kubernetes.io/projected/348f0982-513c-49f7-b9cb-532f0d31063f-kube-api-access-4zwdt\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:05:07.971280 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.971223 4392 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-cabundle-cert\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:05:07.971280 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.971233 4392 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/348f0982-513c-49f7-b9cb-532f0d31063f-proxy-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:05:07.971280 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.971244 4392 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/348f0982-513c-49f7-b9cb-532f0d31063f-kserve-provision-location\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:05:07.971280 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:07.971252 4392 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/348f0982-513c-49f7-b9cb-532f0d31063f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:05:08.456506 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.456471 4392 generic.go:356] "Generic (PLEG): container finished" podID="951a2ed6-d17e-4779-a45e-7876541473b3" containerID="765b129daf41c961e425c323f61e68b58aaa4decd3bd77101ce42962f0207bfe" exitCode=0 Oct 30 19:05:08.456694 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.456543 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" event={"ID":"951a2ed6-d17e-4779-a45e-7876541473b3","Type":"ContainerDied","Data":"765b129daf41c961e425c323f61e68b58aaa4decd3bd77101ce42962f0207bfe"} Oct 30 19:05:08.458661 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.458632 4392 generic.go:356] "Generic (PLEG): container finished" podID="348f0982-513c-49f7-b9cb-532f0d31063f" containerID="6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346" exitCode=0 Oct 30 19:05:08.458755 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.458662 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" event={"ID":"348f0982-513c-49f7-b9cb-532f0d31063f","Type":"ContainerDied","Data":"6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346"} Oct 30 19:05:08.458755 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.458706 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" Oct 30 19:05:08.458755 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.458723 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6" event={"ID":"348f0982-513c-49f7-b9cb-532f0d31063f","Type":"ContainerDied","Data":"bf7845afd7c51aaec49faef89a5c9e3223962f1d8495fa83a9763f38ab10d015"} Oct 30 19:05:08.458755 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.458751 4392 scope.go:122] "RemoveContainer" containerID="8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580" Oct 30 19:05:08.471506 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.471483 4392 scope.go:122] "RemoveContainer" containerID="6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346" Oct 30 19:05:08.483722 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.483704 4392 scope.go:122] "RemoveContainer" containerID="d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077" Oct 30 19:05:08.497595 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.497575 4392 scope.go:122] "RemoveContainer" containerID="8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580" Oct 30 19:05:08.497940 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:05:08.497899 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580\": container with ID starting with 8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580 not found: ID does not exist" containerID="8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580" Oct 30 19:05:08.498009 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.497950 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580"} err="failed to get container status \"8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580\": rpc error: code = NotFound desc = could not find container \"8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580\": container with ID starting with 8863234be25fd419a0472b9fa0039babe12a21722d1334db6cbf4454da60b580 not found: ID does not exist" Oct 30 19:05:08.498009 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.497969 4392 scope.go:122] "RemoveContainer" containerID="6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346" Oct 30 19:05:08.498270 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:05:08.498253 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346\": container with ID starting with 6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346 not found: ID does not exist" containerID="6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346" Oct 30 19:05:08.498335 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.498280 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346"} err="failed to get container status \"6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346\": rpc error: code = NotFound desc = could not find container \"6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346\": container with ID starting with 6fd0c1eac1173bb6b9e274cb705751808d6f7e1a524a153016cf261493c4d346 not found: ID does not exist" Oct 30 19:05:08.498335 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.498305 4392 scope.go:122] "RemoveContainer" containerID="d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077" Oct 30 19:05:08.498540 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:05:08.498520 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077\": container with ID starting with d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077 not found: ID does not exist" containerID="d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077" Oct 30 19:05:08.498585 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.498547 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077"} err="failed to get container status \"d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077\": rpc error: code = NotFound desc = could not find container \"d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077\": container with ID starting with d0202827d8e2c1605f2dcee40e4289171aef5c298b3598a0f61bccb6ba430077 not found: ID does not exist" Oct 30 19:05:08.567539 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.567505 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6"] Oct 30 19:05:08.570797 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:08.570767 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-predictor-b9c5956c9-55tm6"] Oct 30 19:05:09.465042 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:09.465009 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" event={"ID":"951a2ed6-d17e-4779-a45e-7876541473b3","Type":"ContainerStarted","Data":"7a868500d89bbd976c6ddb5a202bf324cc95b729d87fc1afce3f8174890f9ce7"} Oct 30 19:05:09.465475 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:09.465089 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" event={"ID":"951a2ed6-d17e-4779-a45e-7876541473b3","Type":"ContainerStarted","Data":"e0fc5008f54fcc21ff9af0a55db03effcedd9d7e2df716fcf63cea491017160a"} Oct 30 19:05:09.465475 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:09.465317 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:09.528006 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:09.527955 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podStartSLOduration=2.840759188 podStartE2EDuration="6.527938287s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.687179099s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:05:09.526448848 +0000 UTC m=+1671.889462213" watchObservedRunningTime="2026-10-30 19:05:09.527938287 +0000 UTC m=+1671.890951653" Oct 30 19:05:09.785515 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:09.785440 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" path="/var/lib/kubelet/pods/348f0982-513c-49f7-b9cb-532f0d31063f/volumes" Oct 30 19:05:10.470287 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:10.470249 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:10.471209 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:10.471176 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused" Oct 30 19:05:11.474527 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:11.474487 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused" Oct 30 19:05:16.479591 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:16.479563 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:05:16.480106 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:16.480079 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused" Oct 30 19:05:23.875675 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:05:23.875636 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:05:26.480702 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:26.480647 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused" Oct 30 19:05:36.480219 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:36.480171 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused" Oct 30 19:05:46.480900 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:46.480860 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused" Oct 30 19:05:53.875429 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:05:53.875382 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:05:56.480157 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:05:56.480115 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused" Oct 30 19:06:06.480064 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:06.480019 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused" Oct 30 19:06:16.480846 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:16.480803 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused" Oct 30 19:06:22.781273 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:22.781226 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused" Oct 30 19:06:23.875307 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:06:23.875267 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:06:32.782017 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:32.781901 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:06:43.744998 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:43.744958 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn"] Oct 30 19:06:43.745538 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:43.745329 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" containerID="cri-o://e0fc5008f54fcc21ff9af0a55db03effcedd9d7e2df716fcf63cea491017160a" gracePeriod=30 Oct 30 19:06:43.745538 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:43.745396 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kube-rbac-proxy" containerID="cri-o://7a868500d89bbd976c6ddb5a202bf324cc95b729d87fc1afce3f8174890f9ce7" gracePeriod=30 Oct 30 19:06:44.843426 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:44.843393 4392 generic.go:356] "Generic (PLEG): container finished" podID="951a2ed6-d17e-4779-a45e-7876541473b3" containerID="7a868500d89bbd976c6ddb5a202bf324cc95b729d87fc1afce3f8174890f9ce7" exitCode=0 Oct 30 19:06:44.843825 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:44.843464 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" event={"ID":"951a2ed6-d17e-4779-a45e-7876541473b3","Type":"ContainerDied","Data":"7a868500d89bbd976c6ddb5a202bf324cc95b729d87fc1afce3f8174890f9ce7"} Oct 30 19:06:46.475698 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:46.475653 4392 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.29:8643/healthz\": dial tcp 10.132.0.29:8643: connect: connection refused" Oct 30 19:06:48.861763 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.861731 4392 generic.go:356] "Generic (PLEG): container finished" podID="951a2ed6-d17e-4779-a45e-7876541473b3" containerID="e0fc5008f54fcc21ff9af0a55db03effcedd9d7e2df716fcf63cea491017160a" exitCode=0 Oct 30 19:06:48.862184 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.861794 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" event={"ID":"951a2ed6-d17e-4779-a45e-7876541473b3","Type":"ContainerDied","Data":"e0fc5008f54fcc21ff9af0a55db03effcedd9d7e2df716fcf63cea491017160a"} Oct 30 19:06:48.888846 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.888823 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:06:48.973414 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.973379 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-kube-rbac-proxy-sar-config\") pod \"951a2ed6-d17e-4779-a45e-7876541473b3\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " Oct 30 19:06:48.973600 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.973429 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/951a2ed6-d17e-4779-a45e-7876541473b3-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/951a2ed6-d17e-4779-a45e-7876541473b3-kserve-provision-location\") pod \"951a2ed6-d17e-4779-a45e-7876541473b3\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " Oct 30 19:06:48.973600 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.973467 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/951a2ed6-d17e-4779-a45e-7876541473b3-proxy-tls\" (UniqueName: \"kubernetes.io/secret/951a2ed6-d17e-4779-a45e-7876541473b3-proxy-tls\") pod \"951a2ed6-d17e-4779-a45e-7876541473b3\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " Oct 30 19:06:48.973600 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.973505 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/951a2ed6-d17e-4779-a45e-7876541473b3-kube-api-access-22tbw\" (UniqueName: \"kubernetes.io/projected/951a2ed6-d17e-4779-a45e-7876541473b3-kube-api-access-22tbw\") pod \"951a2ed6-d17e-4779-a45e-7876541473b3\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " Oct 30 19:06:48.973600 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.973543 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-cabundle-cert\") pod \"951a2ed6-d17e-4779-a45e-7876541473b3\" (UID: \"951a2ed6-d17e-4779-a45e-7876541473b3\") " Oct 30 19:06:48.973873 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.973838 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-kube-rbac-proxy-sar-config" pod "951a2ed6-d17e-4779-a45e-7876541473b3" (UID: "951a2ed6-d17e-4779-a45e-7876541473b3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:06:48.973873 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.973865 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951a2ed6-d17e-4779-a45e-7876541473b3-kserve-provision-location" pod "951a2ed6-d17e-4779-a45e-7876541473b3" (UID: "951a2ed6-d17e-4779-a45e-7876541473b3"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 19:06:48.974061 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.973990 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-cabundle-cert" pod "951a2ed6-d17e-4779-a45e-7876541473b3" (UID: "951a2ed6-d17e-4779-a45e-7876541473b3"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:06:48.975720 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.975689 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951a2ed6-d17e-4779-a45e-7876541473b3-kube-api-access-22tbw" pod "951a2ed6-d17e-4779-a45e-7876541473b3" (UID: "951a2ed6-d17e-4779-a45e-7876541473b3"). InnerVolumeSpecName "kube-api-access-22tbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:06:48.975720 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:48.975702 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951a2ed6-d17e-4779-a45e-7876541473b3-proxy-tls" pod "951a2ed6-d17e-4779-a45e-7876541473b3" (UID: "951a2ed6-d17e-4779-a45e-7876541473b3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:06:49.074258 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.074218 4392 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:06:49.074258 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.074251 4392 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/951a2ed6-d17e-4779-a45e-7876541473b3-kserve-provision-location\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:06:49.074258 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.074263 4392 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/951a2ed6-d17e-4779-a45e-7876541473b3-proxy-tls\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:06:49.074492 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.074276 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22tbw\" (UniqueName: \"kubernetes.io/projected/951a2ed6-d17e-4779-a45e-7876541473b3-kube-api-access-22tbw\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:06:49.074492 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.074284 4392 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/951a2ed6-d17e-4779-a45e-7876541473b3-cabundle-cert\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:06:49.867494 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.867470 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" Oct 30 19:06:49.867494 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.867482 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn" event={"ID":"951a2ed6-d17e-4779-a45e-7876541473b3","Type":"ContainerDied","Data":"9fb1f288cbeb36f4d304a295084bd8523b42bb6eed6d7b567014a49cd21e21b4"} Oct 30 19:06:49.868065 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.867548 4392 scope.go:122] "RemoveContainer" containerID="7a868500d89bbd976c6ddb5a202bf324cc95b729d87fc1afce3f8174890f9ce7" Oct 30 19:06:49.875736 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.875716 4392 scope.go:122] "RemoveContainer" containerID="e0fc5008f54fcc21ff9af0a55db03effcedd9d7e2df716fcf63cea491017160a" Oct 30 19:06:49.883110 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.883093 4392 scope.go:122] "RemoveContainer" containerID="765b129daf41c961e425c323f61e68b58aaa4decd3bd77101ce42962f0207bfe" Oct 30 19:06:49.939655 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.939628 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn"] Oct 30 19:06:49.953108 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:49.953082 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-42351c4657/isvc-canary-promote-v2-predictor-dc54999c4-ghxkn"] Oct 30 19:06:51.785785 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:06:51.785751 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" path="/var/lib/kubelet/pods/951a2ed6-d17e-4779-a45e-7876541473b3/volumes" Oct 30 19:06:53.877159 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:06:53.877120 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:07:23.876514 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:07:23.876470 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:07:53.875160 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:07:53.875116 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:08:23.875546 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:08:23.875458 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:08:53.874679 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:08:53.874644 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:09:23.874630 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:09:23.874592 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:09:31.205838 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.205742 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rwsmr/must-gather-v7h9r"] Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206154 4392 cpu_manager.go:414] "containerMap: removing container" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="storage-initializer" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206168 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="storage-initializer" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206186 4392 cpu_manager.go:414] "containerMap: removing container" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206191 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206206 4392 cpu_manager.go:414] "containerMap: removing container" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="storage-initializer" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206214 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="storage-initializer" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206227 4392 cpu_manager.go:414] "containerMap: removing container" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kube-rbac-proxy" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206232 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kube-rbac-proxy" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206241 4392 cpu_manager.go:414] "containerMap: removing container" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kube-rbac-proxy" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206246 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kube-rbac-proxy" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206254 4392 cpu_manager.go:414] "containerMap: removing container" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" Oct 30 19:09:31.206265 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206258 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" Oct 30 19:09:31.206602 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206312 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kserve-container" Oct 30 19:09:31.206602 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206324 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kserve-container" Oct 30 19:09:31.206602 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206331 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="348f0982-513c-49f7-b9cb-532f0d31063f" containerName="kube-rbac-proxy" Oct 30 19:09:31.206602 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.206338 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="951a2ed6-d17e-4779-a45e-7876541473b3" containerName="kube-rbac-proxy" Oct 30 19:09:31.209668 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.209651 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:09:31.227217 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.227192 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rwsmr\"/\"default-dockercfg-cjmjh\"" Oct 30 19:09:31.240678 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.240654 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rwsmr\"/\"openshift-service-ca.crt\"" Oct 30 19:09:31.240839 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.240702 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rwsmr\"/\"kube-root-ca.crt\"" Oct 30 19:09:31.241927 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.241884 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rwsmr/must-gather-v7h9r"] Oct 30 19:09:31.351567 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.351529 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-must-gather-output\") pod \"must-gather-v7h9r\" (UID: \"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5\") " pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:09:31.351744 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.351580 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svklx\" (UniqueName: \"kubernetes.io/projected/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-kube-api-access-svklx\") pod \"must-gather-v7h9r\" (UID: \"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5\") " pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:09:31.452851 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.452819 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-must-gather-output\") pod \"must-gather-v7h9r\" (UID: \"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5\") " pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:09:31.452968 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.452873 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svklx\" (UniqueName: \"kubernetes.io/projected/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-kube-api-access-svklx\") pod \"must-gather-v7h9r\" (UID: \"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5\") " pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:09:31.453191 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.453170 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-must-gather-output\") pod \"must-gather-v7h9r\" (UID: \"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5\") " pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:09:31.474837 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.474771 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svklx\" (UniqueName: \"kubernetes.io/projected/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-kube-api-access-svklx\") pod \"must-gather-v7h9r\" (UID: \"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5\") " pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:09:31.540550 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.540507 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:09:31.837612 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.837531 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rwsmr/must-gather-v7h9r"] Oct 30 19:09:31.840943 ip-10-0-135-87 kubenswrapper[4392]: W1030 19:09:31.840918 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ff3cff3_dcb6_4c96_9df6_68093f1c88b5.slice/crio-c90597395afe37601fb3e697e5bd7b0c7747e621ae02c2fcd547ef1f42a21536 WatchSource:0}: Error finding container c90597395afe37601fb3e697e5bd7b0c7747e621ae02c2fcd547ef1f42a21536: Status 404 returned error can't find the container with id c90597395afe37601fb3e697e5bd7b0c7747e621ae02c2fcd547ef1f42a21536 Oct 30 19:09:31.843153 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:31.843134 4392 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 19:09:32.480036 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:32.480000 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" event={"ID":"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5","Type":"ContainerStarted","Data":"c90597395afe37601fb3e697e5bd7b0c7747e621ae02c2fcd547ef1f42a21536"} Oct 30 19:09:38.510979 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:38.510940 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" event={"ID":"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5","Type":"ContainerStarted","Data":"a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac"} Oct 30 19:09:38.511376 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:38.511012 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" event={"ID":"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5","Type":"ContainerStarted","Data":"3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c"} Oct 30 19:09:38.559417 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:09:38.559362 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" podStartSLOduration=1.481027003 podStartE2EDuration="7.55934809s" totalImagesPullingTime="6.078321087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:09:38.559286305 +0000 UTC m=+1940.922299671" watchObservedRunningTime="2026-10-30 19:09:38.55934809 +0000 UTC m=+1940.922361455" Oct 30 19:09:53.875420 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:09:53.875380 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:10:23.875658 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:10:23.875617 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:10:53.877540 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:10:53.877499 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:11:23.875964 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:11:23.875858 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:11:36.983033 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:36.982996 4392 generic.go:356] "Generic (PLEG): container finished" podID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" containerID="3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c" exitCode=0 Oct 30 19:11:36.983462 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:36.983035 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" event={"ID":"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5","Type":"ContainerDied","Data":"3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c"} Oct 30 19:11:36.983462 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:36.983368 4392 scope.go:122] "RemoveContainer" containerID="3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c" Oct 30 19:11:37.214922 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:37.214882 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rwsmr_must-gather-v7h9r_2ff3cff3-dcb6-4c96-9df6-68093f1c88b5/gather/0.log" Oct 30 19:11:42.708292 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:42.708259 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rsknn_3fcc356d-56b0-442e-a80e-6f9d4ad53362/global-pull-secret-syncer/0.log" Oct 30 19:11:42.908592 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:42.908557 4392 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-rwsmr/must-gather-v7h9r"] Oct 30 19:11:42.908830 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:42.908805 4392 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" podUID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" containerName="copy" containerID="cri-o://a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac" gracePeriod=2 Oct 30 19:11:42.922018 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:42.921892 4392 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-rwsmr/must-gather-v7h9r"] Oct 30 19:11:42.923597 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:11:42.923559 4392 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-v7h9r\" is forbidden: User \"system:node:ip-10-0-135-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rwsmr\": no relationship found between node 'ip-10-0-135-87.ec2.internal' and this object" podUID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:11:43.152429 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.152398 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rwsmr_must-gather-v7h9r_2ff3cff3-dcb6-4c96-9df6-68093f1c88b5/copy/0.log" Oct 30 19:11:43.155100 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.155082 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:11:43.170137 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:11:43.170098 4392 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-v7h9r\" is forbidden: User \"system:node:ip-10-0-135-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rwsmr\": no relationship found between node 'ip-10-0-135-87.ec2.internal' and this object" podUID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:11:43.227879 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.227841 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-must-gather-output\") pod \"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5\" (UID: \"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5\") " Oct 30 19:11:43.228050 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.227970 4392 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-kube-api-access-svklx\" (UniqueName: \"kubernetes.io/projected/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-kube-api-access-svklx\") pod \"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5\" (UID: \"2ff3cff3-dcb6-4c96-9df6-68093f1c88b5\") " Oct 30 19:11:43.229282 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.229257 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-must-gather-output" pod "2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" (UID: "2ff3cff3-dcb6-4c96-9df6-68093f1c88b5"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 19:11:43.230179 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.230150 4392 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-kube-api-access-svklx" pod "2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" (UID: "2ff3cff3-dcb6-4c96-9df6-68093f1c88b5"). InnerVolumeSpecName "kube-api-access-svklx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:11:43.329520 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.329436 4392 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svklx\" (UniqueName: \"kubernetes.io/projected/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-kube-api-access-svklx\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:11:43.329520 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.329464 4392 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5-must-gather-output\") on node \"ip-10-0-135-87.ec2.internal\" DevicePath \"\"" Oct 30 19:11:43.717001 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.716970 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9lgj6_bb9ff6a4-3e7d-4c9a-9f14-b4fa6ef8f78e/konnectivity-agent/0.log" Oct 30 19:11:43.785753 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.785720 4392 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" path="/var/lib/kubelet/pods/2ff3cff3-dcb6-4c96-9df6-68093f1c88b5/volumes" Oct 30 19:11:43.946303 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:43.946275 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-87.ec2.internal_ac0cf868632d3632743a3feebbcd95ab/haproxy/0.log" Oct 30 19:11:44.010697 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:44.010614 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rwsmr_must-gather-v7h9r_2ff3cff3-dcb6-4c96-9df6-68093f1c88b5/copy/0.log" Oct 30 19:11:44.011003 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:44.010980 4392 generic.go:356] "Generic (PLEG): container finished" podID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" containerID="a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac" exitCode=143 Oct 30 19:11:44.011101 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:44.011034 4392 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rwsmr/must-gather-v7h9r" Oct 30 19:11:44.011101 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:44.011058 4392 scope.go:122] "RemoveContainer" containerID="a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac" Oct 30 19:11:44.018796 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:44.018779 4392 scope.go:122] "RemoveContainer" containerID="3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c" Oct 30 19:11:44.031497 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:44.031478 4392 scope.go:122] "RemoveContainer" containerID="a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac" Oct 30 19:11:44.031778 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:11:44.031755 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac\": container with ID starting with a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac not found: ID does not exist" containerID="a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac" Oct 30 19:11:44.031826 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:44.031787 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac"} err="failed to get container status \"a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac\": rpc error: code = NotFound desc = could not find container \"a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac\": container with ID starting with a7d04ee9a3bdeb359f6fd25cdd789cf78024373f580525e974404bf5212ed0ac not found: ID does not exist" Oct 30 19:11:44.031826 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:44.031805 4392 scope.go:122] "RemoveContainer" containerID="3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c" Oct 30 19:11:44.032036 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:11:44.032020 4392 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c\": container with ID starting with 3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c not found: ID does not exist" containerID="3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c" Oct 30 19:11:44.032096 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:44.032039 4392 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c"} err="failed to get container status \"3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c\": rpc error: code = NotFound desc = could not find container \"3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c\": container with ID starting with 3ab4ad612890bb907a62cf05a60c2b36c05e3616bb195056824ee9a5bad6a83c not found: ID does not exist" Oct 30 19:11:48.899289 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:48.899263 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_db78bd40-823a-42eb-9814-4c6372e1d872/alertmanager/0.log" Oct 30 19:11:49.020414 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:49.020383 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_db78bd40-823a-42eb-9814-4c6372e1d872/config-reloader/0.log" Oct 30 19:11:49.138063 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:49.138032 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_db78bd40-823a-42eb-9814-4c6372e1d872/kube-rbac-proxy-web/0.log" Oct 30 19:11:49.256977 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:49.256950 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_db78bd40-823a-42eb-9814-4c6372e1d872/kube-rbac-proxy/0.log" Oct 30 19:11:49.375315 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:49.375284 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_db78bd40-823a-42eb-9814-4c6372e1d872/kube-rbac-proxy-metric/0.log" Oct 30 19:11:49.492923 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:49.492878 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_db78bd40-823a-42eb-9814-4c6372e1d872/prom-label-proxy/0.log" Oct 30 19:11:49.615649 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:49.615578 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_db78bd40-823a-42eb-9814-4c6372e1d872/init-config-reloader/0.log" Oct 30 19:11:49.859203 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:49.859163 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-nl9qj_b13b12dd-1988-49b8-ac7a-e6be3e7c6c64/kube-state-metrics/0.log" Oct 30 19:11:49.974666 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:49.974631 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-nl9qj_b13b12dd-1988-49b8-ac7a-e6be3e7c6c64/kube-rbac-proxy-main/0.log" Oct 30 19:11:50.093368 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:50.093341 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-nl9qj_b13b12dd-1988-49b8-ac7a-e6be3e7c6c64/kube-rbac-proxy-self/0.log" Oct 30 19:11:50.222370 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:50.222341 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6687598896-72zcj_4b0a400d-59c2-459d-8f2c-ac39870c8973/metrics-server/0.log" Oct 30 19:11:50.471650 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:50.471625 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkznn_b02c4350-6bbd-443b-83e6-3a5bb737f771/node-exporter/0.log" Oct 30 19:11:50.588492 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:50.588464 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkznn_b02c4350-6bbd-443b-83e6-3a5bb737f771/kube-rbac-proxy/0.log" Oct 30 19:11:50.706662 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:50.706635 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkznn_b02c4350-6bbd-443b-83e6-3a5bb737f771/init-textfile/0.log" Oct 30 19:11:51.502531 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.502497 4392 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2"] Oct 30 19:11:51.502939 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.502846 4392 cpu_manager.go:414] "containerMap: removing container" podUID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" containerName="gather" Oct 30 19:11:51.502939 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.502862 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" containerName="gather" Oct 30 19:11:51.502939 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.502933 4392 cpu_manager.go:414] "containerMap: removing container" podUID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" containerName="copy" Oct 30 19:11:51.503115 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.502942 4392 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" containerName="copy" Oct 30 19:11:51.503115 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.503010 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" containerName="copy" Oct 30 19:11:51.503115 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.503022 4392 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ff3cff3-dcb6-4c96-9df6-68093f1c88b5" containerName="gather" Oct 30 19:11:51.508133 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.508107 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.531158 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.531123 4392 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8mzl4\"/\"default-dockercfg-9xkl2\"" Oct 30 19:11:51.532969 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.532944 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2"] Oct 30 19:11:51.536183 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.536145 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mzl4\"/\"kube-root-ca.crt\"" Oct 30 19:11:51.536183 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.536145 4392 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mzl4\"/\"openshift-service-ca.crt\"" Oct 30 19:11:51.599745 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.599706 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-podres\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.599745 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.599750 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-lib-modules\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.599997 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.599770 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-proc\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.599997 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.599882 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-sys\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.599997 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.599961 4392 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rwz\" (UniqueName: \"kubernetes.io/projected/81148eb9-a298-4b63-80f1-77c458ebae2a-kube-api-access-w7rwz\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.604980 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.604958 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-ln2qc_cba85998-7f86-4815-8ed0-13a5e8013792/kube-rbac-proxy-main/0.log" Oct 30 19:11:51.701069 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.701029 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-sys\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.701276 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.701083 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rwz\" (UniqueName: \"kubernetes.io/projected/81148eb9-a298-4b63-80f1-77c458ebae2a-kube-api-access-w7rwz\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.701276 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.701152 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-sys\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.701276 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.701171 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-podres\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.701276 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.701201 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-lib-modules\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.701276 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.701227 4392 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-proc\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.701276 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.701253 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-podres\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.701505 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.701300 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-lib-modules\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.701505 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.701310 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81148eb9-a298-4b63-80f1-77c458ebae2a-proc\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.722174 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.722146 4392 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rwz\" (UniqueName: \"kubernetes.io/projected/81148eb9-a298-4b63-80f1-77c458ebae2a-kube-api-access-w7rwz\") pod \"perf-node-gather-daemonset-bplg2\" (UID: \"81148eb9-a298-4b63-80f1-77c458ebae2a\") " pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.723714 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.723693 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-ln2qc_cba85998-7f86-4815-8ed0-13a5e8013792/kube-rbac-proxy-self/0.log" Oct 30 19:11:51.820277 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.820190 4392 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:51.841313 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.841289 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-ln2qc_cba85998-7f86-4815-8ed0-13a5e8013792/openshift-state-metrics/0.log" Oct 30 19:11:51.974940 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:51.974898 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43d225eb-51a0-4da0-912a-58b904babd25/prometheus/0.log" Oct 30 19:11:52.093241 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:52.093166 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43d225eb-51a0-4da0-912a-58b904babd25/config-reloader/0.log" Oct 30 19:11:52.118896 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:52.118865 4392 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2"] Oct 30 19:11:52.122214 ip-10-0-135-87 kubenswrapper[4392]: W1030 19:11:52.122180 4392 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod81148eb9_a298_4b63_80f1_77c458ebae2a.slice/crio-80d10a75d87eafd2ec3352b198b2ca2078b2a88822263757463a8114b2473a26 WatchSource:0}: Error finding container 80d10a75d87eafd2ec3352b198b2ca2078b2a88822263757463a8114b2473a26: Status 404 returned error can't find the container with id 80d10a75d87eafd2ec3352b198b2ca2078b2a88822263757463a8114b2473a26 Oct 30 19:11:52.210022 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:52.209990 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43d225eb-51a0-4da0-912a-58b904babd25/thanos-sidecar/0.log" Oct 30 19:11:52.327191 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:52.327162 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43d225eb-51a0-4da0-912a-58b904babd25/kube-rbac-proxy-web/0.log" Oct 30 19:11:52.443271 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:52.443246 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43d225eb-51a0-4da0-912a-58b904babd25/kube-rbac-proxy/0.log" Oct 30 19:11:52.559635 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:52.559603 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43d225eb-51a0-4da0-912a-58b904babd25/kube-rbac-proxy-thanos/0.log" Oct 30 19:11:52.678662 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:52.678631 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43d225eb-51a0-4da0-912a-58b904babd25/init-config-reloader/0.log" Oct 30 19:11:53.011777 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.011752 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-4h6vz_b3ce7149-ac36-45f5-ad3a-feb3acb03ded/prometheus-operator-admission-webhook/0.log" Oct 30 19:11:53.047369 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.047338 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" event={"ID":"81148eb9-a298-4b63-80f1-77c458ebae2a","Type":"ContainerStarted","Data":"2c32aa42526519348acfa890ab5c2d08a29b5c9dd0640a81cc5ac0e2de638e30"} Oct 30 19:11:53.047546 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.047390 4392 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" event={"ID":"81148eb9-a298-4b63-80f1-77c458ebae2a","Type":"ContainerStarted","Data":"80d10a75d87eafd2ec3352b198b2ca2078b2a88822263757463a8114b2473a26"} Oct 30 19:11:53.047546 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.047430 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:11:53.091164 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.091114 4392 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" podStartSLOduration=2.091099918 podStartE2EDuration="2.091099918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:11:53.089550831 +0000 UTC m=+2075.452564198" watchObservedRunningTime="2026-10-30 19:11:53.091099918 +0000 UTC m=+2075.454113283" Oct 30 19:11:53.139790 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.139759 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-675b496b4d-xpc6k_9bba22e6-bc42-4761-85de-dff0a7b5596c/telemeter-client/0.log" Oct 30 19:11:53.255447 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.255369 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-675b496b4d-xpc6k_9bba22e6-bc42-4761-85de-dff0a7b5596c/reload/0.log" Oct 30 19:11:53.372492 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.372463 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-675b496b4d-xpc6k_9bba22e6-bc42-4761-85de-dff0a7b5596c/kube-rbac-proxy/0.log" Oct 30 19:11:53.494367 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.494339 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7df7867bcc-pjv7q_a6b7a2de-aadb-42b6-ae13-77588a054e3e/thanos-query/0.log" Oct 30 19:11:53.610563 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.610484 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7df7867bcc-pjv7q_a6b7a2de-aadb-42b6-ae13-77588a054e3e/kube-rbac-proxy-web/0.log" Oct 30 19:11:53.726579 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.726552 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7df7867bcc-pjv7q_a6b7a2de-aadb-42b6-ae13-77588a054e3e/kube-rbac-proxy/0.log" Oct 30 19:11:53.842669 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.842646 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7df7867bcc-pjv7q_a6b7a2de-aadb-42b6-ae13-77588a054e3e/prom-label-proxy/0.log" Oct 30 19:11:53.875106 ip-10-0-135-87 kubenswrapper[4392]: E1030 19:11:53.875030 4392 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x64kx" containerName="extractor" Oct 30 19:11:53.959236 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:53.959207 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7df7867bcc-pjv7q_a6b7a2de-aadb-42b6-ae13-77588a054e3e/kube-rbac-proxy-rules/0.log" Oct 30 19:11:54.076397 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:54.076365 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7df7867bcc-pjv7q_a6b7a2de-aadb-42b6-ae13-77588a054e3e/kube-rbac-proxy-metrics/0.log" Oct 30 19:11:57.265160 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:57.265125 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-nnv76_0b87df89-bda3-4bfb-8d51-b143ab8fd67e/download-server/0.log" Oct 30 19:11:59.061450 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:11:59.061423 4392 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8mzl4/perf-node-gather-daemonset-bplg2" Oct 30 19:12:00.029898 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:12:00.029871 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5xf4w_f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e/dns/0.log" Oct 30 19:12:00.145426 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:12:00.145392 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5xf4w_f64e4d3c-7d14-4a8d-95d7-9037dc6acf3e/kube-rbac-proxy/0.log" Oct 30 19:12:00.730886 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:12:00.730857 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bvrtd_a3e3ad3c-91c2-4f6b-9b36-250d4e28bba0/dns-node-resolver/0.log" Oct 30 19:12:02.338805 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:12:02.338768 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kbg25_a3669583-9579-4c19-a246-8631b75c07f1/node-ca/0.log" Oct 30 19:12:04.818588 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:12:04.818550 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4mcxv_5fe7ce49-5f2c-4057-b653-6f20a1eae46f/serve-healthcheck-canary/0.log" Oct 30 19:12:06.721377 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:12:06.721342 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x64kx_697b8251-3b4f-49ff-934e-f0242b39ac2a/kube-rbac-proxy/0.log" Oct 30 19:12:06.843375 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:12:06.843343 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x64kx_697b8251-3b4f-49ff-934e-f0242b39ac2a/exporter/0.log" Oct 30 19:12:06.977451 ip-10-0-135-87 kubenswrapper[4392]: I1030 19:12:06.977364 4392 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x64kx_697b8251-3b4f-49ff-934e-f0242b39ac2a/extractor/0.log"