Nov 04 02:03:06.022898 ip-10-0-135-225 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Nov 04 02:03:06.022910 ip-10-0-135-225 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Nov 04 02:03:06.022917 ip-10-0-135-225 systemd[1]: kubelet.service: Failed with result 'resources'. Nov 04 02:03:06.023159 ip-10-0-135-225 systemd[1]: Failed to start Kubernetes Kubelet. Nov 04 02:03:17.609786 ip-10-0-135-225 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Nov 04 02:03:17.609808 ip-10-0-135-225 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4b5d307f0ac943f4abd2d75d289ab62a -- Nov 04 02:06:02.118426 ip-10-0-135-225 systemd[1]: Starting Kubernetes Kubelet... Nov 04 02:06:02.507804 ip-10-0-135-225 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 02:06:02.507804 ip-10-0-135-225 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 02:06:02.507804 ip-10-0-135-225 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 02:06:02.507804 ip-10-0-135-225 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 02:06:02.511783 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511703 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:06:02.511783 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511783 2562 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511787 2562 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511790 2562 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511794 2562 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511796 2562 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511799 2562 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511801 2562 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511804 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511806 2562 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511809 2562 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511811 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511814 2562 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511816 2562 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511823 2562 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511826 2562 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511829 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511831 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511834 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511836 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511838 2562 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:06:02.511850 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511842 2562 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511844 2562 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511847 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511849 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511852 2562 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511854 2562 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511857 2562 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511860 2562 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511862 2562 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511867 2562 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511871 2562 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511874 2562 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511877 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511879 2562 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511881 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511884 2562 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511886 2562 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511889 2562 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511891 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:06:02.512371 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511893 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511896 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511898 2562 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511900 2562 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511902 2562 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511905 2562 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511907 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511910 2562 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511913 2562 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511915 2562 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511917 2562 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511920 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511922 2562 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511925 2562 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511929 2562 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511933 2562 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511936 2562 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511939 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511942 2562 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:06:02.512803 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511944 2562 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511947 2562 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511949 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511952 2562 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511954 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511956 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511959 2562 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511961 2562 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511964 2562 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511966 2562 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511968 2562 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511971 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511973 2562 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511975 2562 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511978 2562 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511981 2562 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511983 2562 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511985 2562 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511988 2562 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.511999 2562 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:06:02.513286 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512001 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512005 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512008 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512010 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512013 2562 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512015 2562 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512018 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512021 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512024 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512026 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512029 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512032 2562 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512034 2562 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512036 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512039 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512041 2562 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512043 2562 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512046 2562 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512049 2562 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512051 2562 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:06:02.513745 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512053 2562 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512056 2562 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512058 2562 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512060 2562 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512063 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512067 2562 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512069 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512852 2562 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512859 2562 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512862 2562 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512865 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512867 2562 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512869 2562 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512873 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512876 2562 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512879 2562 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512882 2562 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512884 2562 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512887 2562 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512890 2562 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:06:02.514199 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512893 2562 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512895 2562 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512898 2562 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512900 2562 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512904 2562 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512909 2562 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512912 2562 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512915 2562 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512918 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512920 2562 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512923 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512926 2562 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512928 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512931 2562 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512933 2562 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512935 2562 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512938 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512940 2562 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512942 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:06:02.514663 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512946 2562 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512950 2562 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512952 2562 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512955 2562 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512957 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512960 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512962 2562 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512965 2562 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512968 2562 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512970 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512973 2562 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512975 2562 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512978 2562 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512981 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512984 2562 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512986 2562 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512989 2562 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512991 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512994 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:06:02.515103 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512996 2562 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.512998 2562 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513001 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513003 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513006 2562 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513008 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513015 2562 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513018 2562 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513020 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513023 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513025 2562 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513028 2562 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513030 2562 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513032 2562 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513036 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513039 2562 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513041 2562 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513044 2562 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513046 2562 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513049 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:06:02.515552 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513051 2562 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513053 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513056 2562 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513059 2562 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513061 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513064 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513067 2562 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513069 2562 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513072 2562 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513074 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513076 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513079 2562 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513081 2562 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513084 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513086 2562 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513088 2562 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513091 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513093 2562 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513096 2562 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513098 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:06:02.516048 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513101 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513103 2562 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513106 2562 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513108 2562 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513110 2562 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513113 2562 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513115 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513118 2562 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513134 2562 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513138 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513141 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513143 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513146 2562 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513148 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.513151 2562 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514438 2562 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514446 2562 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514450 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514453 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514455 2562 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:06:02.516533 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514458 2562 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514460 2562 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514463 2562 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514465 2562 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514468 2562 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514470 2562 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514473 2562 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514475 2562 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514478 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514481 2562 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514483 2562 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514486 2562 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514489 2562 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514491 2562 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514493 2562 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514496 2562 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514498 2562 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514500 2562 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514503 2562 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514505 2562 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:06:02.516991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514508 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514510 2562 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514512 2562 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514515 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514517 2562 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514520 2562 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514522 2562 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514525 2562 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514528 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514530 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514533 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514537 2562 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514540 2562 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514543 2562 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514545 2562 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514548 2562 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514550 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514552 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514555 2562 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514557 2562 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:06:02.517463 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514559 2562 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514562 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514564 2562 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514567 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514569 2562 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514571 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514573 2562 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514576 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514578 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514580 2562 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514583 2562 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514586 2562 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514589 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514592 2562 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514595 2562 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514598 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514600 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514602 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514605 2562 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:06:02.517923 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514607 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514610 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514613 2562 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514615 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514618 2562 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514620 2562 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514623 2562 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514626 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514628 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514631 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514633 2562 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514635 2562 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514638 2562 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514640 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514642 2562 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514645 2562 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514647 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514649 2562 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514652 2562 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514654 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:06:02.518372 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514657 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514659 2562 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514661 2562 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514663 2562 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514666 2562 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514669 2562 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514672 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514674 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514677 2562 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514679 2562 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514682 2562 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514684 2562 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514686 2562 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514689 2562 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514692 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514694 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514696 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514699 2562 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514701 2562 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514704 2562 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:06:02.518828 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514706 2562 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.514708 2562 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515642 2562 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515653 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515659 2562 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515663 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515668 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515671 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515675 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515679 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515682 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515685 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515688 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515691 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515695 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515698 2562 flags.go:64] FLAG: --cgroup-root="" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515701 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515704 2562 flags.go:64] FLAG: --client-ca-file="" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515707 2562 flags.go:64] FLAG: --cloud-provider="external" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515710 2562 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515714 2562 flags.go:64] FLAG: --cluster-domain="" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515716 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515719 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515722 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 02:06:02.519290 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515726 2562 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515730 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515733 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515737 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515740 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515744 2562 flags.go:64] FLAG: --contention-profiling="false" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515747 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515749 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515753 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515755 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515760 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515762 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515765 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515768 2562 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515771 2562 flags.go:64] FLAG: --enable-server="true" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515774 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515777 2562 flags.go:64] FLAG: --event-burst="100" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515780 2562 flags.go:64] FLAG: --event-qps="50" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515784 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515787 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515789 2562 flags.go:64] FLAG: --eviction-hard="" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515794 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515796 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515799 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515802 2562 flags.go:64] FLAG: --eviction-soft="" Nov 04 02:06:02.519830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515805 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515808 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515811 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515814 2562 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515816 2562 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515819 2562 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515822 2562 flags.go:64] FLAG: --feature-gates="" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515826 2562 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515831 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515834 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515837 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515840 2562 flags.go:64] FLAG: --healthz-port="10248" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515843 2562 flags.go:64] FLAG: --help="false" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515847 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515850 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515853 2562 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515855 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515858 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515862 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515864 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515867 2562 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515870 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515872 2562 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 02:06:02.520476 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515875 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515878 2562 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515881 2562 flags.go:64] FLAG: --kube-reserved="" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515883 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515887 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515890 2562 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515892 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515895 2562 flags.go:64] FLAG: --lock-file="" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515898 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515901 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515904 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515909 2562 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515912 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515915 2562 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515918 2562 flags.go:64] FLAG: --logging-format="text" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515920 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515924 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515927 2562 flags.go:64] FLAG: --manifest-url="" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515930 2562 flags.go:64] FLAG: --manifest-url-header="" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515934 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515937 2562 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515942 2562 flags.go:64] FLAG: --max-pods="110" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515946 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515949 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515952 2562 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 02:06:02.521116 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515955 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515958 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515960 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515963 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515970 2562 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515973 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515976 2562 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515978 2562 flags.go:64] FLAG: --pod-cidr="" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515981 2562 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515984 2562 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515987 2562 flags.go:64] FLAG: --pods-per-core="0" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.515998 2562 flags.go:64] FLAG: --port="10250" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516006 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516009 2562 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-017fd60c01f61f4b7" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516012 2562 flags.go:64] FLAG: --qos-reserved="" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516015 2562 flags.go:64] FLAG: --read-only-port="10255" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516018 2562 flags.go:64] FLAG: --register-node="true" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516021 2562 flags.go:64] FLAG: --register-with-taints="" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516024 2562 flags.go:64] FLAG: --registry-burst="10" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516027 2562 flags.go:64] FLAG: --registry-qps="5" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516030 2562 flags.go:64] FLAG: --reserved-cpus="" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516033 2562 flags.go:64] FLAG: --reserved-memory="" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516036 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516039 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516043 2562 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516046 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 02:06:02.521739 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516049 2562 flags.go:64] FLAG: --runonce="false" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516052 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516055 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516060 2562 flags.go:64] FLAG: --seccomp-default="false" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516063 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516065 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516068 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516072 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516074 2562 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516077 2562 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516080 2562 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516083 2562 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516085 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516088 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516091 2562 flags.go:64] FLAG: --system-cgroups="" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516094 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516100 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516102 2562 flags.go:64] FLAG: --tls-cert-file="" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516105 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516109 2562 flags.go:64] FLAG: --tls-min-version="" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516112 2562 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516114 2562 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516117 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516131 2562 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516134 2562 flags.go:64] FLAG: --v="2" Nov 04 02:06:02.522372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516139 2562 flags.go:64] FLAG: --version="false" Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516143 2562 flags.go:64] FLAG: --vmodule="" Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516147 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516150 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516292 2562 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516298 2562 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516301 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516303 2562 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516306 2562 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516308 2562 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516312 2562 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516315 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516318 2562 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516320 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516323 2562 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516326 2562 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516329 2562 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516331 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516334 2562 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516338 2562 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:06:02.522926 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516341 2562 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516344 2562 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516346 2562 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516349 2562 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516351 2562 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516354 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516356 2562 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516359 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516361 2562 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516363 2562 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516366 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516368 2562 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516371 2562 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516373 2562 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516375 2562 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516378 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516380 2562 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516385 2562 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516387 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516391 2562 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:06:02.523606 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516394 2562 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516397 2562 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516401 2562 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516404 2562 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516407 2562 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516409 2562 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516412 2562 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516415 2562 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516417 2562 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516419 2562 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516422 2562 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516424 2562 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516427 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516430 2562 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516432 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516435 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516437 2562 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516439 2562 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516442 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516444 2562 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:06:02.524180 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516446 2562 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516449 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516451 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516453 2562 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516456 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516458 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516461 2562 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516463 2562 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516465 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516469 2562 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516471 2562 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516474 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516476 2562 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516478 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516482 2562 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516485 2562 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516488 2562 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516490 2562 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516493 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516495 2562 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:06:02.524678 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516498 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516501 2562 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516503 2562 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516506 2562 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516508 2562 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516510 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516513 2562 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516515 2562 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516517 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516520 2562 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516522 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516524 2562 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516527 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516529 2562 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516532 2562 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516534 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516537 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516540 2562 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516542 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:06:02.525156 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516545 2562 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516547 2562 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516551 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516553 2562 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516556 2562 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516558 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516561 2562 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516564 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516567 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516569 2562 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516572 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.516598 2562 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516633 2562 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516638 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516641 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516644 2562 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:06:02.525609 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516647 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516649 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516652 2562 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516654 2562 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516656 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516659 2562 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516661 2562 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516663 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516666 2562 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516668 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516670 2562 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516673 2562 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516675 2562 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516678 2562 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516680 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516682 2562 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516684 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516687 2562 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516689 2562 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516693 2562 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:06:02.525984 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516696 2562 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516698 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516701 2562 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516705 2562 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516707 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516709 2562 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516712 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516714 2562 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516717 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516720 2562 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516722 2562 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516725 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516727 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516729 2562 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516732 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516734 2562 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516737 2562 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516739 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516742 2562 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:06:02.526467 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516744 2562 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516746 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516749 2562 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516751 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516753 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516756 2562 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516758 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516761 2562 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516764 2562 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516766 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516768 2562 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516771 2562 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516774 2562 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516777 2562 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516779 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516781 2562 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516785 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516788 2562 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516790 2562 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:06:02.526896 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516793 2562 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516795 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516798 2562 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516802 2562 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516806 2562 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516808 2562 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516811 2562 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516814 2562 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516816 2562 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516818 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516821 2562 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516823 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516826 2562 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516828 2562 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516830 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516833 2562 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516835 2562 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516838 2562 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516840 2562 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:06:02.527370 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516842 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516845 2562 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516848 2562 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516850 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516854 2562 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516857 2562 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516861 2562 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516863 2562 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516866 2562 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516868 2562 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516872 2562 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516874 2562 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516877 2562 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516879 2562 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516882 2562 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516884 2562 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516887 2562 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516889 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516892 2562 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516894 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:06:02.528996 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516897 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516900 2562 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516902 2562 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516904 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.516907 2562 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.525923 2562 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.525937 2562 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.525953 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.525957 2562 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526015 2562 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526020 2562 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526024 2562 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526027 2562 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526030 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526032 2562 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526035 2562 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526038 2562 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526040 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526043 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:06:02.529538 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526046 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526049 2562 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526051 2562 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526055 2562 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526057 2562 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526060 2562 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526062 2562 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526065 2562 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526068 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526070 2562 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526073 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526076 2562 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526078 2562 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526081 2562 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526083 2562 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526087 2562 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526090 2562 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526094 2562 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526096 2562 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:06:02.530044 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526099 2562 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526102 2562 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526104 2562 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526106 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526109 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526111 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526114 2562 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526117 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526119 2562 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526146 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526148 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526151 2562 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526153 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526156 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526159 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526161 2562 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526164 2562 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526168 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526171 2562 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:06:02.530535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526173 2562 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526175 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526178 2562 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526180 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526183 2562 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526185 2562 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526187 2562 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526190 2562 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526192 2562 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526194 2562 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526197 2562 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526199 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526201 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526204 2562 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526206 2562 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526209 2562 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526212 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526214 2562 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526217 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526219 2562 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:06:02.530991 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526221 2562 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526224 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526226 2562 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526229 2562 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526232 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526236 2562 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526241 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526244 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526248 2562 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526251 2562 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526253 2562 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526256 2562 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526259 2562 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526261 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526264 2562 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526266 2562 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526269 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526271 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526273 2562 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526276 2562 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:06:02.531535 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526279 2562 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526281 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526283 2562 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526286 2562 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526288 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526291 2562 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526293 2562 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526295 2562 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526299 2562 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526303 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526307 2562 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526309 2562 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526312 2562 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526314 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526317 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526319 2562 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526321 2562 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:06:02.532018 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526324 2562 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.526351 2562 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526485 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526491 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526494 2562 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526497 2562 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526500 2562 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526504 2562 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526508 2562 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526512 2562 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526515 2562 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526518 2562 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526520 2562 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526523 2562 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526525 2562 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:06:02.532565 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526528 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526531 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526533 2562 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526536 2562 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526538 2562 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526540 2562 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526543 2562 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526545 2562 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526548 2562 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526550 2562 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526552 2562 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526555 2562 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526558 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526560 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526562 2562 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526565 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526567 2562 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526569 2562 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526572 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526575 2562 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:06:02.533182 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526577 2562 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526579 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526601 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526605 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526609 2562 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526612 2562 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526615 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526618 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526621 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526623 2562 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526626 2562 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526628 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526631 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526635 2562 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526638 2562 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526641 2562 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526643 2562 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526646 2562 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526648 2562 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:06:02.533679 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526650 2562 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526653 2562 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526656 2562 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526658 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526661 2562 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526663 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526666 2562 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526668 2562 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526670 2562 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526673 2562 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526675 2562 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526678 2562 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526680 2562 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526682 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526685 2562 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526687 2562 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526690 2562 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526692 2562 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526695 2562 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526698 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:06:02.534208 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526700 2562 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526703 2562 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526705 2562 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526707 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526710 2562 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526712 2562 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526714 2562 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526717 2562 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526719 2562 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526722 2562 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526724 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526726 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526729 2562 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526731 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526733 2562 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526735 2562 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526738 2562 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526740 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526743 2562 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:06:02.534658 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526745 2562 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526747 2562 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526750 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526754 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526757 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526759 2562 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526761 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526764 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526766 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526768 2562 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526771 2562 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526773 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526776 2562 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526779 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526782 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.526803 2562 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 02:06:02.535308 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526836 2562 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526840 2562 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526843 2562 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526846 2562 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526849 2562 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526851 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526854 2562 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526856 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526859 2562 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526862 2562 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526864 2562 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526867 2562 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526869 2562 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526872 2562 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526874 2562 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526877 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526879 2562 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526882 2562 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526884 2562 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526887 2562 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:06:02.535735 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526891 2562 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526893 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526895 2562 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526898 2562 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526900 2562 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526903 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526906 2562 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526908 2562 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526911 2562 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526913 2562 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526916 2562 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526919 2562 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526921 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526923 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526926 2562 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526928 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526931 2562 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526933 2562 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526935 2562 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:06:02.536323 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526938 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526940 2562 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526943 2562 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526945 2562 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526947 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526950 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526952 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526955 2562 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526957 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526959 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526962 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526964 2562 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526967 2562 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526970 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526972 2562 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526974 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526977 2562 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526979 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526981 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:06:02.536781 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526985 2562 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526988 2562 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526990 2562 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526993 2562 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.526997 2562 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527006 2562 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527009 2562 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527012 2562 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527014 2562 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527017 2562 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527019 2562 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527021 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527024 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527026 2562 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527028 2562 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527031 2562 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527033 2562 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527035 2562 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527038 2562 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:06:02.537244 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527040 2562 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527042 2562 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527045 2562 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527047 2562 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527049 2562 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527051 2562 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527054 2562 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527056 2562 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527059 2562 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527061 2562 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527064 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527066 2562 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527068 2562 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527072 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527075 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527077 2562 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527080 2562 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527082 2562 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527084 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527087 2562 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:06:02.537682 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527090 2562 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527092 2562 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527094 2562 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527097 2562 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527099 2562 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527104 2562 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527107 2562 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527110 2562 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:02.527112 2562 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.527177 2562 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.529027 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.529839 2562 server.go:1014] "Starting client certificate rotation" Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.529939 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.529993 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.531474 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 02:06:02.538141 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.534152 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 02:06:02.543524 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.543508 2562 log.go:25] "Validated CRI v1 runtime API" Nov 04 02:06:02.546497 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.546485 2562 log.go:25] "Validated CRI v1 image API" Nov 04 02:06:02.547329 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.547305 2562 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 02:06:02.551465 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.551439 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 88c361d9-e3a7-41f6-ac84-3afb2c888dca:/dev/nvme0n1p4 8d9d869e-6cc4-4989-bb68-d05b4c554844:/dev/nvme0n1p3] Nov 04 02:06:02.551537 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.551464 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 04 02:06:02.557278 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.557175 2562 manager.go:217] Machine: {Timestamp:2026-11-04 02:06:02.555853148 +0000 UTC m=+0.321799220 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3191640 MemoryCapacity:32812007424 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec273020d9c26ce883d9303a01c0de4c SystemUUID:ec273020-d9c2-6ce8-83d9-303a01c0de4c BootID:4b5d307f-0ac9-43f4-abd2-d75d289ab62a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406003712 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406003712 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:57:13:96:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:57:13:96:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:b5:d4:04:47:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812007424 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 02:06:02.557817 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.557807 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 02:06:02.557930 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.557920 2562 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 02:06:02.558830 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.558810 2562 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 02:06:02.558960 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.558831 2562 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-225.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 02:06:02.559005 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.558963 2562 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 02:06:02.559005 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.558969 2562 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 02:06:02.559005 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.559002 2562 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 02:06:02.559077 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.559020 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 02:06:02.559695 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.559686 2562 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 02:06:02.562028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.562016 2562 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 02:06:02.562164 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.562155 2562 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 02:06:02.562736 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.562727 2562 kubelet.go:493] "Attempting to sync node with API server" Nov 04 02:06:02.562768 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.562739 2562 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 02:06:02.562768 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.562750 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 02:06:02.562768 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.562759 2562 kubelet.go:405] "Adding apiserver pod source" Nov 04 02:06:02.562768 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.562767 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 02:06:02.563090 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.563075 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 02:06:02.567104 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.567081 2562 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 02:06:02.571595 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.571582 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 02:06:02.572520 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.572508 2562 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 02:06:02.572558 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.572538 2562 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 02:06:02.572684 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.572673 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 02:06:02.572716 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.572688 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 02:06:02.572716 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.572694 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 02:06:02.572716 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.572699 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 02:06:02.572716 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.572704 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 02:06:02.572716 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.572710 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 02:06:02.573388 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.573380 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 02:06:02.573422 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.573390 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 02:06:02.573422 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.573397 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 02:06:02.573422 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.573402 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 02:06:02.573422 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.573410 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 02:06:02.573422 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.573423 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 02:06:02.574513 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.574504 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 02:06:02.574513 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.574513 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 02:06:02.577984 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.577973 2562 server.go:1263] "Started kubelet" Nov 04 02:06:02.578101 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.578072 2562 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 02:06:02.578173 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.578065 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 02:06:02.578173 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.578148 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 02:06:02.578755 ip-10-0-135-225 systemd[1]: Started Kubernetes Kubelet. Nov 04 02:06:02.579368 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.579357 2562 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 02:06:02.580443 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.580429 2562 server.go:317] "Adding debug handlers to kubelet server" Nov 04 02:06:02.583975 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.583956 2562 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 02:06:02.584060 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.584013 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 02:06:02.584144 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.584075 2562 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:06:02.584694 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.584676 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 02:06:02.584779 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.584680 2562 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 02:06:02.584779 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.584710 2562 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 02:06:02.584867 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.584805 2562 reconstruct.go:97] "Volume reconstruction finished" Nov 04 02:06:02.584867 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.584813 2562 reconciler.go:29] "Reconciler: start to sync state" Nov 04 02:06:02.585446 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.585405 2562 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 04 02:06:02.585543 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.585521 2562 factory.go:153] Registering CRI-O factory Nov 04 02:06:02.585543 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.585537 2562 factory.go:223] Registration of the crio container factory successfully Nov 04 02:06:02.585658 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.585607 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 02:06:02.585658 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.585617 2562 factory.go:55] Registering systemd factory Nov 04 02:06:02.585658 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.585625 2562 factory.go:223] Registration of the systemd container factory successfully Nov 04 02:06:02.585658 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.585641 2562 factory.go:103] Registering Raw factory Nov 04 02:06:02.585658 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.585655 2562 manager.go:1199] Started watching for new ooms in manager Nov 04 02:06:02.586427 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.586413 2562 manager.go:319] Starting recovery of all containers Nov 04 02:06:02.597920 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.597897 2562 manager.go:324] Recovery completed Nov 04 02:06:02.599944 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.599916 2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Nov 04 02:06:02.602688 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.602673 2562 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:06:02.604230 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.604205 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:06:02.604304 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.604241 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:06:02.604304 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.604252 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:06:02.604780 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.604769 2562 cpu_manager.go:226] "Starting" policy="none" Nov 04 02:06:02.604816 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.604778 2562 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 02:06:02.604816 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.604795 2562 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 02:06:02.604880 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.604779 2562 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:06:02.605515 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.605501 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:06:02.605562 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.605528 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:06:02.605562 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.605538 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:06:02.605841 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.605825 2562 policy_none.go:50] "Start" Nov 04 02:06:02.605906 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.605844 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 02:06:02.605906 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.605855 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 02:06:02.606730 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.606719 2562 policy_none.go:44] "Start" Nov 04 02:06:02.652690 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.652660 2562 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 02:06:02.654944 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.654821 2562 manager.go:341] "Starting Device Plugin manager" Nov 04 02:06:02.655017 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.654959 2562 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 02:06:02.655017 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.654968 2562 server.go:87] "Starting device plugin registration server" Nov 04 02:06:02.655208 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.655197 2562 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 02:06:02.655244 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.655211 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 02:06:02.655324 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.655312 2562 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 02:06:02.655426 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.655390 2562 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 02:06:02.655426 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.655396 2562 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 02:06:02.655890 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.655874 2562 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 02:06:02.655963 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.655917 2562 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:06:02.715504 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.715475 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 02:06:02.716849 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.716831 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 02:06:02.716941 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.716855 2562 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 02:06:02.716941 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.716877 2562 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 02:06:02.716941 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.716915 2562 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 04 02:06:02.724926 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.724900 2562 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-225.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 04 02:06:02.724926 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.724909 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-225.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 04 02:06:02.726020 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.724896 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-225.us-west-1.compute.internal.18e4b55cfc7ca44c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-225.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-225.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 02:06:02.577945676 +0000 UTC m=+0.343891748,LastTimestamp:2026-11-04 02:06:02.577945676 +0000 UTC m=+0.343891748,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-225.us-west-1.compute.internal,}" Nov 04 02:06:02.755661 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.755640 2562 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:06:02.756472 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.756458 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:06:02.756532 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.756487 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:06:02.756532 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.756498 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:06:02.756532 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.756524 2562 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.817571 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.817498 2562 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal"] Nov 04 02:06:02.817571 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.817571 2562 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:06:02.818502 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.818486 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:06:02.818562 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.818528 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:06:02.818562 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.818543 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:06:02.819712 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.819701 2562 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:06:02.819863 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.819843 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.819956 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.819879 2562 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:06:02.820534 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.820517 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:06:02.820628 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.820544 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:06:02.820628 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.820553 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:06:02.820628 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.820522 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:06:02.820628 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.820615 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:06:02.820628 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.820625 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:06:02.821642 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.821630 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.821707 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.821654 2562 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:06:02.822390 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.822377 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:06:02.822456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.822406 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:06:02.822456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.822417 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:06:02.841247 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.841225 2562 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.844848 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.844832 2562 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.866297 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.866277 2562 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 02:06:02.866368 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.866341 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-957gm" Nov 04 02:06:02.881860 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.881830 2562 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-225.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Nov 04 02:06:02.881987 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.881795 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-225.us-west-1.compute.internal.18e4b55cfe0dacfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-225.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-225.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-225.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 02:06:02.604227837 +0000 UTC m=+0.370173909,LastTimestamp:2026-11-04 02:06:02.604227837 +0000 UTC m=+0.370173909,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-225.us-west-1.compute.internal,}" Nov 04 02:06:02.882202 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.882181 2562 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Nov 04 02:06:02.882259 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:02.882217 2562 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 04 02:06:02.885705 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.885686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.885788 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.885715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.885788 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.885738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c08604dc1c779dd155121103c79330-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"d1c08604dc1c779dd155121103c79330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.986221 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.986191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c08604dc1c779dd155121103c79330-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"d1c08604dc1c779dd155121103c79330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.986221 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.986223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.986478 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.986242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.986478 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.986283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.986478 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.986283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c08604dc1c779dd155121103c79330-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"d1c08604dc1c779dd155121103c79330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:02.986478 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:02.986313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:03.043770 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.043740 2562 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 02:06:03.044047 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:03.044028 2562 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-135-225.us-west-1.compute.internal\" not found" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:03.096522 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:03.096458 2562 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-225.us-west-1.compute.internal\" not found" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:03.144206 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.144185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:03.148846 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.148832 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:03.244987 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.244959 2562 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:06:03.245923 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.245904 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:06:03.246032 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.245946 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:06:03.246032 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.245974 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:06:03.246032 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.246002 2562 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:03.304202 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.304174 2562 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:03.304202 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:03.304203 2562 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-225.us-west-1.compute.internal\": node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:06:03.416217 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:03.416118 2562 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:06:03.516426 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:03.516396 2562 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:06:03.529544 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.529525 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 04 02:06:03.529718 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.529694 2562 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 02:06:03.529762 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:03.529674 2562 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://ac66bc7e1762247a7b68d1e1f0c05235-88944398bf9cb6fa.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-135-225.us-west-1.compute.internal.18e4b55cfe0df2bb\": read tcp 10.0.135.225:59208->3.147.97.216:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-135-225.us-west-1.compute.internal.18e4b55cfe0df2bb default 5859 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-225.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-225.us-west-1.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-225.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 02:06:02 +0000 UTC,LastTimestamp:2026-11-04 02:06:02.756491665 +0000 UTC m=+0.522437737,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-225.us-west-1.compute.internal,}" Nov 04 02:06:03.617410 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:03.617374 2562 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:06:03.718227 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:03.718136 2562 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:06:03.818600 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:03.818573 2562 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:06:03.870369 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.870323 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 02:01:03 +0000 UTC" deadline="2028-04-09 22:11:19.456040957 +0000 UTC" Nov 04 02:06:03.870369 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.870365 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12548h5m15.585679139s" Nov 04 02:06:03.893399 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.893374 2562 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 02:06:03.985092 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.985009 2562 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:03.989152 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:03.989117 2562 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 02:06:04.041744 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:04.041718 2562 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 02:06:04.042926 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:04.042911 2562 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:06:04.101762 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:04.101723 2562 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 02:06:04.187365 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:04.187335 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c08604dc1c779dd155121103c79330.slice/crio-913848c05087147f51367be37206221902a27ba69aafc893a14cedeba7088dca WatchSource:0}: Error finding container 913848c05087147f51367be37206221902a27ba69aafc893a14cedeba7088dca: Status 404 returned error can't find the container with id 913848c05087147f51367be37206221902a27ba69aafc893a14cedeba7088dca Nov 04 02:06:04.192598 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:04.192579 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 02:06:04.218060 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:04.218038 2562 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 02:06:04.564846 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:04.564820 2562 apiserver.go:52] "Watching apiserver" Nov 04 02:06:04.586053 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:04.586033 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 04 02:06:04.593366 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:04.593345 2562 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 02:06:04.618538 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:04.618521 2562 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 02:06:04.618626 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:04.618613 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal"] Nov 04 02:06:05.942465 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:05.942438 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 02:06:05.977881 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:05.977839 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"d1c08604dc1c779dd155121103c79330","Type":"ContainerStarted","Data":"913848c05087147f51367be37206221902a27ba69aafc893a14cedeba7088dca"} Nov 04 02:06:06.051401 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:06.051378 2562 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 02:06:06.051474 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:06.051435 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rkp46" Nov 04 02:06:06.102910 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:06.102885 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5147ba6182c6560312729cb5a30df3cf.slice/crio-bc9e2c3aa5020c6a3f5e3d023b180cb0f0cb1ce75ec1ca6ab456d379de6f85aa WatchSource:0}: Error finding container bc9e2c3aa5020c6a3f5e3d023b180cb0f0cb1ce75ec1ca6ab456d379de6f85aa: Status 404 returned error can't find the container with id bc9e2c3aa5020c6a3f5e3d023b180cb0f0cb1ce75ec1ca6ab456d379de6f85aa Nov 04 02:06:06.981269 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:06.981217 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"5147ba6182c6560312729cb5a30df3cf","Type":"ContainerStarted","Data":"bc9e2c3aa5020c6a3f5e3d023b180cb0f0cb1ce75ec1ca6ab456d379de6f85aa"} Nov 04 02:06:07.984410 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:07.984376 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"d1c08604dc1c779dd155121103c79330","Type":"ContainerStarted","Data":"95b9f93a8ae6c98a8559e88eee4248b06e7e4676eaf5ea8ffaa853935fb1d5e0"} Nov 04 02:06:07.985677 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:07.985654 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"5147ba6182c6560312729cb5a30df3cf","Type":"ContainerStarted","Data":"b0ca9a18b2e50973d7e90e0b1553e9ea6a440673e18653b92bfd28f9ed9dc315"} Nov 04 02:06:08.096714 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:08.096629 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" podStartSLOduration=3.096616216 podStartE2EDuration="3.096616216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:08.096596463 +0000 UTC m=+4.605380009" watchObservedRunningTime="2026-11-04 02:06:08.096616216 +0000 UTC m=+4.605399756" Nov 04 02:06:20.002939 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:20.002779 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal_5147ba6182c6560312729cb5a30df3cf/setup/0.log" Nov 04 02:06:20.003334 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:20.002952 2562 generic.go:356] "Generic (PLEG): container finished" podID="5147ba6182c6560312729cb5a30df3cf" containerID="b0ca9a18b2e50973d7e90e0b1553e9ea6a440673e18653b92bfd28f9ed9dc315" exitCode=1 Nov 04 02:06:20.003334 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:20.002982 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"5147ba6182c6560312729cb5a30df3cf","Type":"ContainerDied","Data":"b0ca9a18b2e50973d7e90e0b1553e9ea6a440673e18653b92bfd28f9ed9dc315"} Nov 04 02:06:21.006407 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:21.006381 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal_5147ba6182c6560312729cb5a30df3cf/setup/0.log" Nov 04 02:06:21.006772 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:21.006423 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"5147ba6182c6560312729cb5a30df3cf","Type":"ContainerStarted","Data":"e57f5c64666ef85964d34a21b42dc8f0df27930b37c5ec2b9c0bc4018af4aacb"} Nov 04 02:06:22.662648 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.662616 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-59cvz"] Nov 04 02:06:22.663030 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.662856 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rkp46" Nov 04 02:06:22.667089 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.667075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.712550 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.712525 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-jc6hh"] Nov 04 02:06:22.715425 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.715411 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ftvnd"] Nov 04 02:06:22.715572 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.715557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.718011 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.717993 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:22.718093 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:22.718055 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:22.736818 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.736793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-system-cni-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.736900 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.736824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:22.736900 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.736844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aa32bba-6dad-4e5d-8959-02f7eeecd506-iptables-alerter-script\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.736900 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.736859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2lbf\" (UniqueName: \"kubernetes.io/projected/6aa32bba-6dad-4e5d-8959-02f7eeecd506-kube-api-access-c2lbf\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.737060 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.736926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.737060 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.736973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45mwj\" (UniqueName: \"kubernetes.io/projected/91a1bffe-aa40-4eea-8941-3dc7851929ee-kube-api-access-45mwj\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.737060 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.737006 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.737201 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.737056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.737201 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.737085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-kubelet-config\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:22.737201 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.737113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-cnibin\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.737201 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.737140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.737201 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.737184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-dbus\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:22.737373 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.737202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aa32bba-6dad-4e5d-8959-02f7eeecd506-host-slash\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.761843 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.761820 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 02:06:22.761948 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.761880 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 02:06:22.761948 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.761880 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rtznt\"" Nov 04 02:06:22.761948 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.761885 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 02:06:22.778653 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.778632 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 02:06:22.779166 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.779150 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-5zgbq"] Nov 04 02:06:22.779218 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.779210 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 02:06:22.779405 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.779391 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 02:06:22.779754 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.779741 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 02:06:22.779800 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.779762 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 02:06:22.781717 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.781705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.786659 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.786614 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kvkfc\"" Nov 04 02:06:22.791666 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.791649 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-f9dj5"] Nov 04 02:06:22.794093 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.794079 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:22.827876 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.827843 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-b4zjs"] Nov 04 02:06:22.830479 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.830462 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.837346 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2lbf\" (UniqueName: \"kubernetes.io/projected/6aa32bba-6dad-4e5d-8959-02f7eeecd506-kube-api-access-c2lbf\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.837482 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.837482 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-kubelet-config\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:22.837482 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837388 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-lib-modules\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.837482 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837414 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 02:06:22.837482 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-var-lib-kubelet\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.837482 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-cnibin\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-kubelet-config\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-cnibin\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-dbus\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysconfig\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-tuned\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837678 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aa32bba-6dad-4e5d-8959-02f7eeecd506-host-slash\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-system-cni-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837730 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aa32bba-6dad-4e5d-8959-02f7eeecd506-host-slash\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.837767 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aa32bba-6dad-4e5d-8959-02f7eeecd506-iptables-alerter-script\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837780 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-dbus\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837794 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-system-cni-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mwj\" (UniqueName: \"kubernetes.io/projected/91a1bffe-aa40-4eea-8941-3dc7851929ee-kube-api-access-45mwj\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-systemd\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-sys\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb2bl\" (UniqueName: \"kubernetes.io/projected/c9648b4c-d83c-4ed0-8844-eab675c6aefe-kube-api-access-xb2bl\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.837986 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxnm8\" (UniqueName: \"kubernetes.io/projected/6acaaa12-25fa-4251-8354-17f293e2cc26-kube-api-access-bxnm8\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838069 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.838097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-modprobe-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-conf\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838211 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6acaaa12-25fa-4251-8354-17f293e2cc26-hosts-file\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acaaa12-25fa-4251-8354-17f293e2cc26-tmp-dir\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-kubernetes\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-run\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-host\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-tmp\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.838456 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:22.838452 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:22.838812 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:22.838503 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret podName:c7cc9b6d-5ad9-4c08-b523-acee6c40a031 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:23.338486321 +0000 UTC m=+19.847269871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret") pod "global-pull-secret-syncer-ftvnd" (UID: "c7cc9b6d-5ad9-4c08-b523-acee6c40a031") : object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:22.838812 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838558 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.838812 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838729 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aa32bba-6dad-4e5d-8959-02f7eeecd506-iptables-alerter-script\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.838917 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.838821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.850062 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.850037 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 02:06:22.850341 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.850329 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 02:06:22.855966 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.855948 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-wrp97"] Nov 04 02:06:22.858499 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.858486 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:22.858556 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:22.858541 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:22.861488 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.861472 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kbkqw"] Nov 04 02:06:22.864765 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.864737 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.879452 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.879427 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-rm28p"] Nov 04 02:06:22.882073 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.882057 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:22.882165 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:22.882119 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:22.883606 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.883592 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 02:06:22.895494 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.895473 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-pd9w7"] Nov 04 02:06:22.897900 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.897887 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:22.900366 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.900347 2562 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 02:06:22.904671 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.904653 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2lbf\" (UniqueName: \"kubernetes.io/projected/6aa32bba-6dad-4e5d-8959-02f7eeecd506-kube-api-access-c2lbf\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.905796 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.905780 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45mwj\" (UniqueName: \"kubernetes.io/projected/91a1bffe-aa40-4eea-8941-3dc7851929ee-kube-api-access-45mwj\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:22.914699 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.914643 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-g52g2"] Nov 04 02:06:22.916993 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.916979 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:22.927868 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.927851 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-db624\"" Nov 04 02:06:22.927964 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.927891 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qq5vw\"" Nov 04 02:06:22.928020 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.927965 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-szjlx\"" Nov 04 02:06:22.928020 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.927974 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ckptg\"" Nov 04 02:06:22.928020 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.927989 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 02:06:22.929618 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.929603 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 02:06:22.929680 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.929624 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 02:06:22.929680 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.929650 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 02:06:22.929680 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.929661 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 02:06:22.929927 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.929915 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 02:06:22.939124 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-host\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.939173 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:22.939173 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939147 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-ovn\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.939173 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-node-log\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.939328 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-log-socket\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.939328 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.939328 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939266 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-host\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.939328 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-kubelet\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.939472 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.939472 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-netd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.939472 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b432d50-c888-420f-980f-4e7dd474a44a-ovn-node-metrics-cert\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.939472 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-system-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.939472 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-bin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.939678 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-daemon-config\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.939678 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-tuned\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.939678 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a874e0e-2ae1-4716-a5ca-6faf7033f145-serviceca\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:22.939678 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-socket-dir-parent\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.939678 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-etc-kubernetes\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.939678 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-bin\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.939864 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939680 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39f89f68-342c-4b27-a499-43c10f62a478-konnectivity-ca\") pod \"konnectivity-agent-g52g2\" (UID: \"39f89f68-342c-4b27-a499-43c10f62a478\") " pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:22.939864 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgb99\" (UniqueName: \"kubernetes.io/projected/1b432d50-c888-420f-980f-4e7dd474a44a-kube-api-access-bgb99\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.939864 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939756 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.939864 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.939864 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-sys\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.939864 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-sys\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.939864 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxnm8\" (UniqueName: \"kubernetes.io/projected/6acaaa12-25fa-4251-8354-17f293e2cc26-kube-api-access-bxnm8\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-var-lib-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwrkj\" (UniqueName: \"kubernetes.io/projected/3a874e0e-2ae1-4716-a5ca-6faf7033f145-kube-api-access-gwrkj\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6acaaa12-25fa-4251-8354-17f293e2cc26-hosts-file\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acaaa12-25fa-4251-8354-17f293e2cc26-tmp-dir\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-cnibin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.939987 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6acaaa12-25fa-4251-8354-17f293e2cc26-hosts-file\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-cni-binary-copy\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940036 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-netns\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-kubernetes\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-kubernetes\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-kubelet\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.940157 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-k8s-cni-cncf-io\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940183 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acaaa12-25fa-4251-8354-17f293e2cc26-tmp-dir\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-multus\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940216 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-multus-certs\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p6pg\" (UniqueName: \"kubernetes.io/projected/0b2bef4e-d720-45a8-a182-94ed8805f845-kube-api-access-2p6pg\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-tmp\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-systemd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-lib-modules\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-var-lib-kubelet\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-netns\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940450 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-script-lib\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940460 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-lib-modules\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940495 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-var-lib-kubelet\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a874e0e-2ae1-4716-a5ca-6faf7033f145-host\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysconfig\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-systemd-units\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.940672 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940587 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-config\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940622 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysconfig\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39f89f68-342c-4b27-a499-43c10f62a478-agent-certs\") pod \"konnectivity-agent-g52g2\" (UID: \"39f89f68-342c-4b27-a499-43c10f62a478\") " pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-hostroot\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-systemd\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb2bl\" (UniqueName: \"kubernetes.io/projected/c9648b4c-d83c-4ed0-8844-eab675c6aefe-kube-api-access-xb2bl\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-modprobe-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-systemd\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-conf\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-slash\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-etc-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-env-overrides\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-run\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940934 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-modprobe-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm84k\" (UniqueName: \"kubernetes.io/projected/2cbe4ad0-7162-4e44-af92-3a3449226a55-kube-api-access-wm84k\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:22.941232 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-conf-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:22.941694 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.940979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-run\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941694 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.941090 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-conf\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.941694 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.941650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-tuned\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.942278 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.942260 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-tmp\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:22.953081 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.953064 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 02:06:22.953149 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.953068 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 02:06:22.953223 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.953210 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 02:06:22.961260 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.961246 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w"] Nov 04 02:06:22.963923 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.963911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:22.971969 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.971954 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 02:06:22.977245 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.977228 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:06:22.985405 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:22.985383 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa32bba_6dad_4e5d_8959_02f7eeecd506.slice/crio-49cb499320957b748a36b25248cfd3524ad4e557f5ac8c7f3dc438bb98d0f68c WatchSource:0}: Error finding container 49cb499320957b748a36b25248cfd3524ad4e557f5ac8c7f3dc438bb98d0f68c: Status 404 returned error can't find the container with id 49cb499320957b748a36b25248cfd3524ad4e557f5ac8c7f3dc438bb98d0f68c Nov 04 02:06:22.999764 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:22.999747 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxnm8\" (UniqueName: \"kubernetes.io/projected/6acaaa12-25fa-4251-8354-17f293e2cc26-kube-api-access-bxnm8\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:23.001121 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.001104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb2bl\" (UniqueName: \"kubernetes.io/projected/c9648b4c-d83c-4ed0-8844-eab675c6aefe-kube-api-access-xb2bl\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:23.009600 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.009581 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-59cvz" event={"ID":"6aa32bba-6dad-4e5d-8959-02f7eeecd506","Type":"ContainerStarted","Data":"49cb499320957b748a36b25248cfd3524ad4e557f5ac8c7f3dc438bb98d0f68c"} Nov 04 02:06:23.015406 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.015387 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 02:06:23.015475 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.015435 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 02:06:23.028338 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.028314 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h6pb6\"" Nov 04 02:06:23.028338 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.028328 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 02:06:23.028481 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.028329 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 02:06:23.028481 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.028347 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z899q\"" Nov 04 02:06:23.028481 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.028427 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-kn9lr\"" Nov 04 02:06:23.038560 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.038542 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:06:23.041774 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.041758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-systemd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.041842 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.041772 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-systemd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.041842 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.041802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-device-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.041920 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.041860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-netns\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.041920 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.041887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-script-lib\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042008 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.041951 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-netns\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042008 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.041971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:23.042110 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a874e0e-2ae1-4716-a5ca-6faf7033f145-host\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:23.042156 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vllk\" (UniqueName: \"kubernetes.io/projected/da56277b-ffe8-4870-a562-26fb88dcc0c3-kube-api-access-5vllk\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.042156 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-systemd-units\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042235 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042153 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a874e0e-2ae1-4716-a5ca-6faf7033f145-host\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:23.042235 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-config\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042235 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.042158 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:23.042235 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-systemd-units\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042235 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.042231 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs podName:2cbe4ad0-7162-4e44-af92-3a3449226a55 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:23.542216483 +0000 UTC m=+20.051000024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs") pod "network-metrics-daemon-rm28p" (UID: "2cbe4ad0-7162-4e44-af92-3a3449226a55") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:23.042547 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39f89f68-342c-4b27-a499-43c10f62a478-agent-certs\") pod \"konnectivity-agent-g52g2\" (UID: \"39f89f68-342c-4b27-a499-43c10f62a478\") " pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:23.042547 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-hostroot\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.042547 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-slash\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042547 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-etc-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042547 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042441 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-hostroot\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.042547 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042449 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-env-overrides\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042547 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042482 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-slash\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042547 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.042547 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042493 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-etc-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042547 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-registration-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm84k\" (UniqueName: \"kubernetes.io/projected/2cbe4ad0-7162-4e44-af92-3a3449226a55-kube-api-access-wm84k\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-conf-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-conf-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-ovn\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-node-log\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042796 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-log-socket\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042843 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-ovn\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-kubelet\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.042910 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-netd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-node-log\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b432d50-c888-420f-980f-4e7dd474a44a-ovn-node-metrics-cert\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042940 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-env-overrides\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-script-lib\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-system-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.042998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-bin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043000 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-log-socket\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-daemon-config\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043058 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-netd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-socket-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043088 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-bin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043103 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-system-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043145 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-kubelet\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a874e0e-2ae1-4716-a5ca-6faf7033f145-serviceca\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:23.043470 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-socket-dir-parent\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043613 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-daemon-config\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043645 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-config\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-etc-kubernetes\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043692 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-etc-kubernetes\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-bin\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043720 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-socket-dir-parent\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043807 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39f89f68-342c-4b27-a499-43c10f62a478-konnectivity-ca\") pod \"konnectivity-agent-g52g2\" (UID: \"39f89f68-342c-4b27-a499-43c10f62a478\") " pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043818 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-bin\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgb99\" (UniqueName: \"kubernetes.io/projected/1b432d50-c888-420f-980f-4e7dd474a44a-kube-api-access-bgb99\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.043936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044153 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-var-lib-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwrkj\" (UniqueName: \"kubernetes.io/projected/3a874e0e-2ae1-4716-a5ca-6faf7033f145-kube-api-access-gwrkj\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-cnibin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-cni-binary-copy\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044239 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-var-lib-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-netns\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-sys-fs\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-kubelet\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a874e0e-2ae1-4716-a5ca-6faf7033f145-serviceca\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-k8s-cni-cncf-io\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044399 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39f89f68-342c-4b27-a499-43c10f62a478-konnectivity-ca\") pod \"konnectivity-agent-g52g2\" (UID: \"39f89f68-342c-4b27-a499-43c10f62a478\") " pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044411 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-multus\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-k8s-cni-cncf-io\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-multus-certs\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-kubelet\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p6pg\" (UniqueName: \"kubernetes.io/projected/0b2bef4e-d720-45a8-a182-94ed8805f845-kube-api-access-2p6pg\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-cnibin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044671 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-multus-certs\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.044852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-multus\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.045552 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044843 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-netns\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.045552 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.044882 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-cni-binary-copy\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.045634 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.045620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b432d50-c888-420f-980f-4e7dd474a44a-ovn-node-metrics-cert\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.046105 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.046085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39f89f68-342c-4b27-a499-43c10f62a478-agent-certs\") pod \"konnectivity-agent-g52g2\" (UID: \"39f89f68-342c-4b27-a499-43c10f62a478\") " pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:23.048419 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:23.048400 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a1bffe_aa40_4eea_8941_3dc7851929ee.slice/crio-ac0cf56c6919934acfa2f07001cc887756181b7993cc82e2447a3925419de284 WatchSource:0}: Error finding container ac0cf56c6919934acfa2f07001cc887756181b7993cc82e2447a3925419de284: Status 404 returned error can't find the container with id ac0cf56c6919934acfa2f07001cc887756181b7993cc82e2447a3925419de284 Nov 04 02:06:23.092144 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.092125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:06:23.101168 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.101143 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 02:06:23.101218 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.101174 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 02:06:23.101218 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.101184 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hd962 for pod openshift-network-diagnostics/network-check-target-wrp97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:23.101278 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.101254 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962 podName:a50b6ca7-2a42-4dff-a86e-0e73749997cc nodeName:}" failed. No retries permitted until 2026-11-04 02:06:23.601230863 +0000 UTC m=+20.110014402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hd962" (UniqueName: "kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962") pod "network-check-target-wrp97" (UID: "a50b6ca7-2a42-4dff-a86e-0e73749997cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:23.102698 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.102670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:06:23.103821 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.103796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm84k\" (UniqueName: \"kubernetes.io/projected/2cbe4ad0-7162-4e44-af92-3a3449226a55-kube-api-access-wm84k\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:23.103883 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.103844 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgb99\" (UniqueName: \"kubernetes.io/projected/1b432d50-c888-420f-980f-4e7dd474a44a-kube-api-access-bgb99\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.104536 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.104514 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p6pg\" (UniqueName: \"kubernetes.io/projected/0b2bef4e-d720-45a8-a182-94ed8805f845-kube-api-access-2p6pg\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.104610 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.104595 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwrkj\" (UniqueName: \"kubernetes.io/projected/3a874e0e-2ae1-4716-a5ca-6faf7033f145-kube-api-access-gwrkj\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:23.141105 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.141080 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b4zjs" Nov 04 02:06:23.143070 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:23.143043 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9648b4c_d83c_4ed0_8844_eab675c6aefe.slice/crio-9c7be667d5ce134ad0b8596f20a662669c59569e6e36d199ca84eb3c5220fbf7 WatchSource:0}: Error finding container 9c7be667d5ce134ad0b8596f20a662669c59569e6e36d199ca84eb3c5220fbf7: Status 404 returned error can't find the container with id 9c7be667d5ce134ad0b8596f20a662669c59569e6e36d199ca84eb3c5220fbf7 Nov 04 02:06:23.143314 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:23.143275 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6acaaa12_25fa_4251_8354_17f293e2cc26.slice/crio-76801ec76ac2afaf5feb21cafbd75f61680fc1c0eebc7df933a636a7d304e10f WatchSource:0}: Error finding container 76801ec76ac2afaf5feb21cafbd75f61680fc1c0eebc7df933a636a7d304e10f: Status 404 returned error can't find the container with id 76801ec76ac2afaf5feb21cafbd75f61680fc1c0eebc7df933a636a7d304e10f Nov 04 02:06:23.145808 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.145782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.145913 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.145824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-registration-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.145913 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.145883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.146056 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.145957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-socket-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.146056 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.146014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-sys-fs\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.146133 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.146077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-device-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.146491 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.146218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vllk\" (UniqueName: \"kubernetes.io/projected/da56277b-ffe8-4870-a562-26fb88dcc0c3-kube-api-access-5vllk\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.146491 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.146329 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.146491 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.146333 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.146491 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.146445 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-registration-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.146491 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.146469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-socket-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.146491 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.146470 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-device-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.146815 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.146544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-sys-fs\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.151866 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:23.151842 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2bef4e_d720_45a8_a182_94ed8805f845.slice/crio-a82561f778335ae525941a4185a3a162a452bce17457d398a86847e74d2341d4 WatchSource:0}: Error finding container a82561f778335ae525941a4185a3a162a452bce17457d398a86847e74d2341d4: Status 404 returned error can't find the container with id a82561f778335ae525941a4185a3a162a452bce17457d398a86847e74d2341d4 Nov 04 02:06:23.188000 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.187936 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:23.196963 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:23.196943 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b432d50_c888_420f_980f_4e7dd474a44a.slice/crio-212ed90324864507066d142a48bdcecae5a06c03713bd53244554ca26f13a615 WatchSource:0}: Error finding container 212ed90324864507066d142a48bdcecae5a06c03713bd53244554ca26f13a615: Status 404 returned error can't find the container with id 212ed90324864507066d142a48bdcecae5a06c03713bd53244554ca26f13a615 Nov 04 02:06:23.206958 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.206940 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vllk\" (UniqueName: \"kubernetes.io/projected/da56277b-ffe8-4870-a562-26fb88dcc0c3-kube-api-access-5vllk\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.207810 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.207795 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:06:23.216681 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:23.216660 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a874e0e_2ae1_4716_a5ca_6faf7033f145.slice/crio-3e4f3dd3f6b470ac1ccd9b9ddda16b7e3fcfc95e4d8e35774c62b008f48f1479 WatchSource:0}: Error finding container 3e4f3dd3f6b470ac1ccd9b9ddda16b7e3fcfc95e4d8e35774c62b008f48f1479: Status 404 returned error can't find the container with id 3e4f3dd3f6b470ac1ccd9b9ddda16b7e3fcfc95e4d8e35774c62b008f48f1479 Nov 04 02:06:23.226455 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.226434 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:23.234790 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:23.234766 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f89f68_342c_4b27_a499_43c10f62a478.slice/crio-b3e9522e2d194f8c8f0fc5bc299b46b99979b77b249bc1e533667cf1eeef5300 WatchSource:0}: Error finding container b3e9522e2d194f8c8f0fc5bc299b46b99979b77b249bc1e533667cf1eeef5300: Status 404 returned error can't find the container with id b3e9522e2d194f8c8f0fc5bc299b46b99979b77b249bc1e533667cf1eeef5300 Nov 04 02:06:23.277149 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.277126 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:06:23.285619 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:23.285601 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda56277b_ffe8_4870_a562_26fb88dcc0c3.slice/crio-02019e9df5a86d8332fd6ba93caa4e1eea89010481b8e639bdc96a98bb218c24 WatchSource:0}: Error finding container 02019e9df5a86d8332fd6ba93caa4e1eea89010481b8e639bdc96a98bb218c24: Status 404 returned error can't find the container with id 02019e9df5a86d8332fd6ba93caa4e1eea89010481b8e639bdc96a98bb218c24 Nov 04 02:06:23.347520 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.347493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:23.347618 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.347602 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:23.347658 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.347649 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret podName:c7cc9b6d-5ad9-4c08-b523-acee6c40a031 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:24.347634349 +0000 UTC m=+20.856417877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret") pod "global-pull-secret-syncer-ftvnd" (UID: "c7cc9b6d-5ad9-4c08-b523-acee6c40a031") : object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:23.549017 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.548943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:23.549151 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.549082 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:23.549151 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.549134 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs podName:2cbe4ad0-7162-4e44-af92-3a3449226a55 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:24.549119285 +0000 UTC m=+21.057902818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs") pod "network-metrics-daemon-rm28p" (UID: "2cbe4ad0-7162-4e44-af92-3a3449226a55") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:23.649774 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.649738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:23.649933 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.649871 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 02:06:23.649933 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.649890 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 02:06:23.649933 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.649901 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hd962 for pod openshift-network-diagnostics/network-check-target-wrp97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:23.650064 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:23.649958 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962 podName:a50b6ca7-2a42-4dff-a86e-0e73749997cc nodeName:}" failed. No retries permitted until 2026-11-04 02:06:24.649941881 +0000 UTC m=+21.158725410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd962" (UniqueName: "kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962") pod "network-check-target-wrp97" (UID: "a50b6ca7-2a42-4dff-a86e-0e73749997cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:23.668877 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.668826 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:01:22 +0000 UTC" deadline="2028-05-10 14:09:01.582710824 +0000 UTC" Nov 04 02:06:23.668877 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:23.668873 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13284h2m37.913840448s" Nov 04 02:06:24.013377 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.013346 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b4zjs" event={"ID":"0b2bef4e-d720-45a8-a182-94ed8805f845","Type":"ContainerStarted","Data":"a82561f778335ae525941a4185a3a162a452bce17457d398a86847e74d2341d4"} Nov 04 02:06:24.015209 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.015188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal_5147ba6182c6560312729cb5a30df3cf/setup/0.log" Nov 04 02:06:24.015342 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.015223 2562 generic.go:356] "Generic (PLEG): container finished" podID="5147ba6182c6560312729cb5a30df3cf" containerID="e57f5c64666ef85964d34a21b42dc8f0df27930b37c5ec2b9c0bc4018af4aacb" exitCode=0 Nov 04 02:06:24.015342 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.015304 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"5147ba6182c6560312729cb5a30df3cf","Type":"ContainerDied","Data":"e57f5c64666ef85964d34a21b42dc8f0df27930b37c5ec2b9c0bc4018af4aacb"} Nov 04 02:06:24.015415 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.015346 2562 scope.go:122] "RemoveContainer" containerID="b0ca9a18b2e50973d7e90e0b1553e9ea6a440673e18653b92bfd28f9ed9dc315" Nov 04 02:06:24.015714 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.015701 2562 scope.go:122] "RemoveContainer" containerID="b0ca9a18b2e50973d7e90e0b1553e9ea6a440673e18653b92bfd28f9ed9dc315" Nov 04 02:06:24.016544 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.016520 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pd9w7" event={"ID":"3a874e0e-2ae1-4716-a5ca-6faf7033f145","Type":"ContainerStarted","Data":"3e4f3dd3f6b470ac1ccd9b9ddda16b7e3fcfc95e4d8e35774c62b008f48f1479"} Nov 04 02:06:24.017734 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.017716 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" event={"ID":"1b432d50-c888-420f-980f-4e7dd474a44a","Type":"ContainerStarted","Data":"212ed90324864507066d142a48bdcecae5a06c03713bd53244554ca26f13a615"} Nov 04 02:06:24.018822 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.018794 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f9dj5" event={"ID":"6acaaa12-25fa-4251-8354-17f293e2cc26","Type":"ContainerStarted","Data":"76801ec76ac2afaf5feb21cafbd75f61680fc1c0eebc7df933a636a7d304e10f"} Nov 04 02:06:24.019852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.019833 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" event={"ID":"c9648b4c-d83c-4ed0-8844-eab675c6aefe","Type":"ContainerStarted","Data":"9c7be667d5ce134ad0b8596f20a662669c59569e6e36d199ca84eb3c5220fbf7"} Nov 04 02:06:24.020933 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.020915 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" event={"ID":"91a1bffe-aa40-4eea-8941-3dc7851929ee","Type":"ContainerStarted","Data":"ac0cf56c6919934acfa2f07001cc887756181b7993cc82e2447a3925419de284"} Nov 04 02:06:24.022132 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.022105 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" event={"ID":"da56277b-ffe8-4870-a562-26fb88dcc0c3","Type":"ContainerStarted","Data":"02019e9df5a86d8332fd6ba93caa4e1eea89010481b8e639bdc96a98bb218c24"} Nov 04 02:06:24.023222 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.023201 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g52g2" event={"ID":"39f89f68-342c-4b27-a499-43c10f62a478","Type":"ContainerStarted","Data":"b3e9522e2d194f8c8f0fc5bc299b46b99979b77b249bc1e533667cf1eeef5300"} Nov 04 02:06:24.027245 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.027206 2562 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal_openshift-machine-config-operator_5147ba6182c6560312729cb5a30df3cf_0 in pod sandbox bc9e2c3aa5020c6a3f5e3d023b180cb0f0cb1ce75ec1ca6ab456d379de6f85aa from index: no such id: 'b0ca9a18b2e50973d7e90e0b1553e9ea6a440673e18653b92bfd28f9ed9dc315'" containerID="b0ca9a18b2e50973d7e90e0b1553e9ea6a440673e18653b92bfd28f9ed9dc315" Nov 04 02:06:24.027336 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.027257 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0ca9a18b2e50973d7e90e0b1553e9ea6a440673e18653b92bfd28f9ed9dc315"} err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal_openshift-machine-config-operator_5147ba6182c6560312729cb5a30df3cf_0 in pod sandbox bc9e2c3aa5020c6a3f5e3d023b180cb0f0cb1ce75ec1ca6ab456d379de6f85aa from index: no such id: 'b0ca9a18b2e50973d7e90e0b1553e9ea6a440673e18653b92bfd28f9ed9dc315'" Nov 04 02:06:24.356988 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.356691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:24.356988 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.356933 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:24.357223 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.356996 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret podName:c7cc9b6d-5ad9-4c08-b523-acee6c40a031 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:26.356977968 +0000 UTC m=+22.865761494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret") pod "global-pull-secret-syncer-ftvnd" (UID: "c7cc9b6d-5ad9-4c08-b523-acee6c40a031") : object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:24.558601 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.558568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:24.558757 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.558724 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:24.558800 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.558782 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs podName:2cbe4ad0-7162-4e44-af92-3a3449226a55 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:26.558764388 +0000 UTC m=+23.067547927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs") pod "network-metrics-daemon-rm28p" (UID: "2cbe4ad0-7162-4e44-af92-3a3449226a55") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:24.659921 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.659830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:24.660077 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.660014 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 02:06:24.660077 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.660036 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 02:06:24.660077 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.660050 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hd962 for pod openshift-network-diagnostics/network-check-target-wrp97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:24.660229 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.660106 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962 podName:a50b6ca7-2a42-4dff-a86e-0e73749997cc nodeName:}" failed. No retries permitted until 2026-11-04 02:06:26.660088659 +0000 UTC m=+23.168872254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd962" (UniqueName: "kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962") pod "network-check-target-wrp97" (UID: "a50b6ca7-2a42-4dff-a86e-0e73749997cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:24.669898 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.669843 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:01:22 +0000 UTC" deadline="2028-08-10 22:49:14.638418258 +0000 UTC" Nov 04 02:06:24.669898 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.669895 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15500h42m49.96852727s" Nov 04 02:06:24.974867 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.974785 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:24.975035 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.974907 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:24.975035 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.974982 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:24.975154 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.975056 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:24.975154 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:24.975116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:24.975245 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:24.975203 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:25.039202 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:25.039167 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"5147ba6182c6560312729cb5a30df3cf","Type":"ContainerStarted","Data":"36ee08d8b76d7d15adc005e65b1cc6ee0900d499ad19aa1aa6676ba35543f725"} Nov 04 02:06:25.153218 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:25.153161 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" podStartSLOduration=20.153137719 podStartE2EDuration="20.153137719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:25.152788469 +0000 UTC m=+21.661572016" watchObservedRunningTime="2026-11-04 02:06:25.153137719 +0000 UTC m=+21.661921267" Nov 04 02:06:26.376186 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:26.375915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:26.376186 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.376056 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:26.376186 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.376114 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret podName:c7cc9b6d-5ad9-4c08-b523-acee6c40a031 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:30.376098877 +0000 UTC m=+26.884882416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret") pod "global-pull-secret-syncer-ftvnd" (UID: "c7cc9b6d-5ad9-4c08-b523-acee6c40a031") : object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:26.578688 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:26.578092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:26.578688 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.578263 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:26.578688 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.578341 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs podName:2cbe4ad0-7162-4e44-af92-3a3449226a55 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:30.578322349 +0000 UTC m=+27.087105875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs") pod "network-metrics-daemon-rm28p" (UID: "2cbe4ad0-7162-4e44-af92-3a3449226a55") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:26.679805 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:26.679260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:26.679805 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.679446 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 02:06:26.679805 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.679461 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 02:06:26.679805 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.679470 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hd962 for pod openshift-network-diagnostics/network-check-target-wrp97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:26.679805 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.679513 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962 podName:a50b6ca7-2a42-4dff-a86e-0e73749997cc nodeName:}" failed. No retries permitted until 2026-11-04 02:06:30.679500129 +0000 UTC m=+27.188283660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd962" (UniqueName: "kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962") pod "network-check-target-wrp97" (UID: "a50b6ca7-2a42-4dff-a86e-0e73749997cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:26.975998 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:26.975194 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:26.975998 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.975357 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:26.975998 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:26.975723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:26.975998 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.975810 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:26.975998 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:26.975851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:26.975998 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:26.975911 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:27.049848 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:27.049017 2562 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="d2cc2b2464d7b871d6c47c8e04950d6f810a3127fd85960f8897ea9284c33716" exitCode=0 Nov 04 02:06:27.049848 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:27.049074 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" event={"ID":"91a1bffe-aa40-4eea-8941-3dc7851929ee","Type":"ContainerDied","Data":"d2cc2b2464d7b871d6c47c8e04950d6f810a3127fd85960f8897ea9284c33716"} Nov 04 02:06:28.055099 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:28.055025 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g52g2" event={"ID":"39f89f68-342c-4b27-a499-43c10f62a478","Type":"ContainerStarted","Data":"32158a3943c8d4d518a927f596d6a802aab63affcee5bd0a6cda7c2aae74dd42"} Nov 04 02:06:28.058847 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:28.058791 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pd9w7" event={"ID":"3a874e0e-2ae1-4716-a5ca-6faf7033f145","Type":"ContainerStarted","Data":"86300c0b9c2d67d363bb81873be3f053416e984268621421e328e221f1fd731b"} Nov 04 02:06:28.178887 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:28.178574 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g52g2" podStartSLOduration=2.331720485 podStartE2EDuration="6.178555529s" totalImagesPullingTime="3.846835044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:28.177793733 +0000 UTC m=+24.686577281" watchObservedRunningTime="2026-11-04 02:06:28.178555529 +0000 UTC m=+24.687339081" Nov 04 02:06:28.229639 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:28.229520 2562 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:28.230155 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:28.230106 2562 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:28.292475 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:28.292431 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pd9w7" podStartSLOduration=1.7301117160000001 podStartE2EDuration="6.292417273s" totalImagesPullingTime="4.562305557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:28.291861926 +0000 UTC m=+24.800645474" watchObservedRunningTime="2026-11-04 02:06:28.292417273 +0000 UTC m=+24.801200819" Nov 04 02:06:28.976093 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:28.975277 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:28.976093 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:28.975433 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:28.976093 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:28.975839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:28.976093 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:28.975930 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:28.976093 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:28.975987 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:28.976093 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:28.976054 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:29.068373 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:29.068173 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" event={"ID":"da56277b-ffe8-4870-a562-26fb88dcc0c3","Type":"ContainerStarted","Data":"84be5df953e52a209b39af26ca88909033bd687366403fee8116c126e612007f"} Nov 04 02:06:30.071208 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.071172 2562 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 02:06:30.410500 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.410417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:30.410650 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.410571 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:30.410650 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.410634 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret podName:c7cc9b6d-5ad9-4c08-b523-acee6c40a031 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:38.410614892 +0000 UTC m=+34.919398432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret") pod "global-pull-secret-syncer-ftvnd" (UID: "c7cc9b6d-5ad9-4c08-b523-acee6c40a031") : object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:30.611849 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.611821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:30.612020 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.612005 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:30.612077 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.612069 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs podName:2cbe4ad0-7162-4e44-af92-3a3449226a55 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:38.612052202 +0000 UTC m=+35.120835736 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs") pod "network-metrics-daemon-rm28p" (UID: "2cbe4ad0-7162-4e44-af92-3a3449226a55") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:30.712570 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.712540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:30.712783 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.712735 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 02:06:30.712783 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.712771 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 02:06:30.712879 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.712786 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hd962 for pod openshift-network-diagnostics/network-check-target-wrp97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:30.712879 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.712848 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962 podName:a50b6ca7-2a42-4dff-a86e-0e73749997cc nodeName:}" failed. No retries permitted until 2026-11-04 02:06:38.712829491 +0000 UTC m=+35.221613020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd962" (UniqueName: "kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962") pod "network-check-target-wrp97" (UID: "a50b6ca7-2a42-4dff-a86e-0e73749997cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:30.733270 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.733242 2562 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 02:06:30.928663 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.928528 2562 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T02:06:30.733267426Z","UUID":"447a10bb-1fbc-4e6c-9d85-cf6d87d8187b","Handler":null,"Name":"","Endpoint":""} Nov 04 02:06:30.929946 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.929919 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 02:06:30.929946 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.929952 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 02:06:30.975683 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.975365 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:30.975683 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.975461 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:30.975683 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.975519 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:30.975683 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.975575 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:30.975683 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:30.975603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:30.975683 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:30.975650 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:31.075188 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:31.074833 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f9dj5" event={"ID":"6acaaa12-25fa-4251-8354-17f293e2cc26","Type":"ContainerStarted","Data":"1f7cbe0ed9d106585f6003975243d1c1d37446ddbeff7063acea2005d33f71e7"} Nov 04 02:06:31.076938 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:31.076912 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" event={"ID":"da56277b-ffe8-4870-a562-26fb88dcc0c3","Type":"ContainerStarted","Data":"4b7cff8e737f83b6ebd5d5d9fb85270a098cf45e2044073f24a15d8a919efaea"} Nov 04 02:06:31.188462 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:31.188204 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-f9dj5" podStartSLOduration=1.488875631 podStartE2EDuration="9.188190907s" totalImagesPullingTime="7.699315276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:31.188009854 +0000 UTC m=+27.696793402" watchObservedRunningTime="2026-11-04 02:06:31.188190907 +0000 UTC m=+27.696974454" Nov 04 02:06:32.081036 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:32.080959 2562 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="973dc385f560a387b3be6d7c5a54f886244730168c91b3a1fa671ed6e032480b" exitCode=0 Nov 04 02:06:32.081486 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:32.081058 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" event={"ID":"91a1bffe-aa40-4eea-8941-3dc7851929ee","Type":"ContainerDied","Data":"973dc385f560a387b3be6d7c5a54f886244730168c91b3a1fa671ed6e032480b"} Nov 04 02:06:32.083316 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:32.082823 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b4zjs" event={"ID":"0b2bef4e-d720-45a8-a182-94ed8805f845","Type":"ContainerStarted","Data":"1d88edfaacd982db5d267fb453850169ada1baa12f263adf660881b43ca290dd"} Nov 04 02:06:32.084457 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:32.084435 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-59cvz" event={"ID":"6aa32bba-6dad-4e5d-8959-02f7eeecd506","Type":"ContainerStarted","Data":"710a26c010d8cdc54ecb0a05579ffc480c9df36d92d5ebd71955112d1a4032cc"} Nov 04 02:06:32.314426 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:32.314372 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-59cvz" podStartSLOduration=3.1762074240000002 podStartE2EDuration="10.314360662s" totalImagesPullingTime="7.138153238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:32.31380836 +0000 UTC m=+28.822591910" watchObservedRunningTime="2026-11-04 02:06:32.314360662 +0000 UTC m=+28.823144209" Nov 04 02:06:32.432281 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:32.432185 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-b4zjs" podStartSLOduration=2.5494387830000003 podStartE2EDuration="10.432165916s" totalImagesPullingTime="7.882727133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:32.431750725 +0000 UTC m=+28.940534284" watchObservedRunningTime="2026-11-04 02:06:32.432165916 +0000 UTC m=+28.940949465" Nov 04 02:06:32.975238 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:32.975204 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:32.975238 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:32.975232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:32.975465 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:32.975218 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:32.975465 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:32.975359 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:32.975465 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:32.975441 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:32.975618 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:32.975501 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:33.088343 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.088231 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" event={"ID":"c9648b4c-d83c-4ed0-8844-eab675c6aefe","Type":"ContainerStarted","Data":"a9e42b62fb64e8b520e3071dabb6c1109512323469872a9a441015410ad62c2f"} Nov 04 02:06:33.090724 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.090699 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" event={"ID":"da56277b-ffe8-4870-a562-26fb88dcc0c3","Type":"ContainerStarted","Data":"a8f20147e51f5deec344802ea59773aab5eaed79c370de8c836bcd1caf14e0ec"} Nov 04 02:06:33.206906 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.206851 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" podStartSLOduration=1.610665441 podStartE2EDuration="11.206833301s" totalImagesPullingTime="9.59616786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:33.206132713 +0000 UTC m=+29.714916244" watchObservedRunningTime="2026-11-04 02:06:33.206833301 +0000 UTC m=+29.715616850" Nov 04 02:06:33.328869 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.328811 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" podStartSLOduration=2.834269333 podStartE2EDuration="11.32878961s" totalImagesPullingTime="8.494520277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:33.327980598 +0000 UTC m=+29.836764146" watchObservedRunningTime="2026-11-04 02:06:33.32878961 +0000 UTC m=+29.837573160" Nov 04 02:06:33.579570 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.579500 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kv495"] Nov 04 02:06:33.582482 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.582463 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.638719 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.638692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-root\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.638831 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.638741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-textfile\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.638831 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.638761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-wtmp\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.638831 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.638820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.638980 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.638894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-sys\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.638980 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.638932 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-accelerators-collector-config\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.638980 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.638959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfpjg\" (UniqueName: \"kubernetes.io/projected/11c1b4b3-e146-441c-b2e1-7ce37ba61863-kube-api-access-wfpjg\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.639112 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.639096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-metrics-client-ca\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.639160 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.639127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-tls\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.644704 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.644676 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 02:06:33.644850 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.644714 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 02:06:33.644850 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.644714 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 04 02:06:33.644934 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.644855 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 04 02:06:33.644934 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.644858 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 04 02:06:33.644934 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.644898 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xlwps\"" Nov 04 02:06:33.644934 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.644902 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 04 02:06:33.740024 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-root\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740147 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-textfile\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740147 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-wtmp\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740147 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740108 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-root\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740147 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740351 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-sys\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740351 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-accelerators-collector-config\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740351 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740200 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-wtmp\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740351 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfpjg\" (UniqueName: \"kubernetes.io/projected/11c1b4b3-e146-441c-b2e1-7ce37ba61863-kube-api-access-wfpjg\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740351 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740227 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-sys\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740351 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-metrics-client-ca\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740351 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-tls\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740657 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-textfile\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740657 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:33.740464 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Nov 04 02:06:33.740657 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:33.740563 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-tls podName:11c1b4b3-e146-441c-b2e1-7ce37ba61863 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:34.240546315 +0000 UTC m=+30.749329845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-tls") pod "node-exporter-kv495" (UID: "11c1b4b3-e146-441c-b2e1-7ce37ba61863") : secret "node-exporter-tls" not found Nov 04 02:06:33.740775 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740696 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-accelerators-collector-config\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.740808 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.740763 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-metrics-client-ca\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.744002 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.743982 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:33.800936 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:33.800915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfpjg\" (UniqueName: \"kubernetes.io/projected/11c1b4b3-e146-441c-b2e1-7ce37ba61863-kube-api-access-wfpjg\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:34.094320 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:34.094273 2562 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="948b8a37c88925126cdb9ecec24f9e68aa5eaf21d422bb72421c1a95fbe02d67" exitCode=0 Nov 04 02:06:34.094768 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:34.094319 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" event={"ID":"91a1bffe-aa40-4eea-8941-3dc7851929ee","Type":"ContainerDied","Data":"948b8a37c88925126cdb9ecec24f9e68aa5eaf21d422bb72421c1a95fbe02d67"} Nov 04 02:06:34.243796 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:34.243769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-tls\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:34.246167 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:34.246142 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-tls\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:34.497510 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:34.497439 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:06:34.508680 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:34.508659 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c1b4b3_e146_441c_b2e1_7ce37ba61863.slice/crio-0f2a9234127298e19f33426c0282ecec0be0a2381d02f85fd3584a968689025d WatchSource:0}: Error finding container 0f2a9234127298e19f33426c0282ecec0be0a2381d02f85fd3584a968689025d: Status 404 returned error can't find the container with id 0f2a9234127298e19f33426c0282ecec0be0a2381d02f85fd3584a968689025d Nov 04 02:06:34.975318 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:34.975233 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:34.975443 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:34.975345 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:34.975443 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:34.975354 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:34.975443 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:34.975428 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:34.975524 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:34.975449 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:34.975575 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:34.975558 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:35.097616 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:35.097585 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kv495" event={"ID":"11c1b4b3-e146-441c-b2e1-7ce37ba61863","Type":"ContainerStarted","Data":"0f2a9234127298e19f33426c0282ecec0be0a2381d02f85fd3584a968689025d"} Nov 04 02:06:36.102149 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:36.101977 2562 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="df23bab4f6889abc23967ff753974dd43a6149b36b189e94aa040276fa92ebe2" exitCode=0 Nov 04 02:06:36.102472 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:36.102073 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" event={"ID":"91a1bffe-aa40-4eea-8941-3dc7851929ee","Type":"ContainerDied","Data":"df23bab4f6889abc23967ff753974dd43a6149b36b189e94aa040276fa92ebe2"} Nov 04 02:06:36.974210 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:36.974175 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:36.974472 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:36.974184 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:36.974472 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:36.974300 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:36.974472 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:36.974188 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:36.974472 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:36.974362 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:36.974472 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:36.974463 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:37.106163 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:37.106130 2562 generic.go:356] "Generic (PLEG): container finished" podID="11c1b4b3-e146-441c-b2e1-7ce37ba61863" containerID="dd6f13120f942ba9db74815e1b974cad2df34d4621353763e0f60917a2930aac" exitCode=0 Nov 04 02:06:37.106600 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:37.106164 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kv495" event={"ID":"11c1b4b3-e146-441c-b2e1-7ce37ba61863","Type":"ContainerDied","Data":"dd6f13120f942ba9db74815e1b974cad2df34d4621353763e0f60917a2930aac"} Nov 04 02:06:38.110556 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:38.110511 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kv495" event={"ID":"11c1b4b3-e146-441c-b2e1-7ce37ba61863","Type":"ContainerStarted","Data":"3115ef93f7b9278604cc2ac71ecc10f6d5f1222f3e8af586628c869960d57bfd"} Nov 04 02:06:38.111115 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:38.110577 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kv495" event={"ID":"11c1b4b3-e146-441c-b2e1-7ce37ba61863","Type":"ContainerStarted","Data":"6412864066adccefaab18d721a0bbc81b74a2a1db4ee96ccad0e8058184b2a43"} Nov 04 02:06:38.229811 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:38.229740 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kv495" podStartSLOduration=3.576958109 podStartE2EDuration="5.22972204s" totalImagesPullingTime="1.575899809s" totalInitContainerRuntime="76.864122ms" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:38.228689008 +0000 UTC m=+34.737472557" watchObservedRunningTime="2026-11-04 02:06:38.22972204 +0000 UTC m=+34.738505590" Nov 04 02:06:38.477066 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:38.477033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:38.477211 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.477152 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:38.477211 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.477206 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret podName:c7cc9b6d-5ad9-4c08-b523-acee6c40a031 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:54.477192639 +0000 UTC m=+50.985976179 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret") pod "global-pull-secret-syncer-ftvnd" (UID: "c7cc9b6d-5ad9-4c08-b523-acee6c40a031") : object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:38.678104 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:38.678029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:38.678244 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.678157 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:38.678244 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.678215 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs podName:2cbe4ad0-7162-4e44-af92-3a3449226a55 nodeName:}" failed. No retries permitted until 2026-11-04 02:06:54.678198645 +0000 UTC m=+51.186982172 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs") pod "network-metrics-daemon-rm28p" (UID: "2cbe4ad0-7162-4e44-af92-3a3449226a55") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:38.779266 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:38.779236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:38.779411 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.779361 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 02:06:38.779411 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.779378 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 02:06:38.779411 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.779388 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hd962 for pod openshift-network-diagnostics/network-check-target-wrp97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:38.779513 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.779430 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962 podName:a50b6ca7-2a42-4dff-a86e-0e73749997cc nodeName:}" failed. No retries permitted until 2026-11-04 02:06:54.77941782 +0000 UTC m=+51.288201359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd962" (UniqueName: "kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962") pod "network-check-target-wrp97" (UID: "a50b6ca7-2a42-4dff-a86e-0e73749997cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:38.974934 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:38.974859 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:38.974934 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:38.974923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:38.975121 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:38.974946 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:38.975121 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.975025 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:38.975121 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.975082 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:38.975220 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:38.975151 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:39.114166 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:39.114134 2562 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="2189beba771387783c3afd21df8791f1c093113efa327fbd4b9e5d95a8426ecc" exitCode=0 Nov 04 02:06:39.114529 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:39.114214 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" event={"ID":"91a1bffe-aa40-4eea-8941-3dc7851929ee","Type":"ContainerDied","Data":"2189beba771387783c3afd21df8791f1c093113efa327fbd4b9e5d95a8426ecc"} Nov 04 02:06:40.119496 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:40.119458 2562 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="c6042ff34b7d39b6bc97e965ee3f9b110b921ceb51b9c049852d8a42d8de0c43" exitCode=0 Nov 04 02:06:40.120023 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:40.119508 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" event={"ID":"91a1bffe-aa40-4eea-8941-3dc7851929ee","Type":"ContainerDied","Data":"c6042ff34b7d39b6bc97e965ee3f9b110b921ceb51b9c049852d8a42d8de0c43"} Nov 04 02:06:40.974995 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:40.974955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:40.974995 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:40.974999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:40.975208 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:40.974996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:40.975208 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:40.975132 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:40.975340 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:40.975219 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:40.975384 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:40.975328 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:41.126680 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:41.126633 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" event={"ID":"91a1bffe-aa40-4eea-8941-3dc7851929ee","Type":"ContainerStarted","Data":"a284b96388db83aba6bc428f4adf0c9be82488b7042992be554114633029b0b5"} Nov 04 02:06:41.298104 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:41.298004 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jc6hh" podStartSLOduration=7.2856990790000005 podStartE2EDuration="19.297985045s" totalImagesPullingTime="12.012285966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:41.297021614 +0000 UTC m=+37.805805163" watchObservedRunningTime="2026-11-04 02:06:41.297985045 +0000 UTC m=+37.806768594" Nov 04 02:06:42.974394 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:42.974360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:42.974394 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:42.974395 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:42.974815 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:42.974395 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:42.974815 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:42.974480 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:42.974815 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:42.974607 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:42.974815 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:42.974710 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:44.139754 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.139587 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:06:44.140242 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.140041 2562 generic.go:356] "Generic (PLEG): container finished" podID="1b432d50-c888-420f-980f-4e7dd474a44a" containerID="952552fef87ebfd2bc61ca5b60bb5ee93b6cec74d8ccc8c32f3bbdb51e9b629e" exitCode=1 Nov 04 02:06:44.140242 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.140072 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" event={"ID":"1b432d50-c888-420f-980f-4e7dd474a44a","Type":"ContainerStarted","Data":"3e39da7266655e82fad1c3d8e05d70aada7bd2c50e61fbd0dfd08c68c63217ad"} Nov 04 02:06:44.140242 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.140137 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" event={"ID":"1b432d50-c888-420f-980f-4e7dd474a44a","Type":"ContainerStarted","Data":"58de6d40d93c777d64b626733d39ca3b313514697270c65a2af5d8822fd9147a"} Nov 04 02:06:44.140242 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.140167 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" event={"ID":"1b432d50-c888-420f-980f-4e7dd474a44a","Type":"ContainerStarted","Data":"779967a2b3eb9201d013b350d6be91c1e8a2fc534ded7f5dd4ae8f6b83d3872e"} Nov 04 02:06:44.140242 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.140194 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" event={"ID":"1b432d50-c888-420f-980f-4e7dd474a44a","Type":"ContainerStarted","Data":"4458826e91d1496941a030a23cc08894bab97a859d2834cd378f93ed5a2392dc"} Nov 04 02:06:44.140242 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.140227 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" event={"ID":"1b432d50-c888-420f-980f-4e7dd474a44a","Type":"ContainerDied","Data":"952552fef87ebfd2bc61ca5b60bb5ee93b6cec74d8ccc8c32f3bbdb51e9b629e"} Nov 04 02:06:44.140458 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.140254 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" event={"ID":"1b432d50-c888-420f-980f-4e7dd474a44a","Type":"ContainerStarted","Data":"5b2317cfbb92c3c15f59fc0d7679cdbfcb54b6db4f2bf85abb208e5f820cfbaa"} Nov 04 02:06:44.974607 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.974581 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:44.974804 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.974659 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:44.974804 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:44.974761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:44.974804 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:44.974777 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:44.974955 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:44.974820 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:44.974955 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:44.974893 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:46.146367 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:46.146340 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:06:46.146736 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:46.146638 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" event={"ID":"1b432d50-c888-420f-980f-4e7dd474a44a","Type":"ContainerStarted","Data":"2b698bb71dd45e4eac268c653866d09df99ca5d4b4cf7edc98612ee9a363dac8"} Nov 04 02:06:46.583111 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:46.583076 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:46.583372 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:46.583203 2562 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 02:06:46.583726 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:46.583711 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:06:46.975141 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:46.975116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:46.975267 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:46.975149 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:46.975267 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:46.975204 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:46.975267 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:46.975254 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:46.975390 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:46.975350 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:46.975426 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:46.975398 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:48.154756 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.154551 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:06:48.155376 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.155022 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" event={"ID":"1b432d50-c888-420f-980f-4e7dd474a44a","Type":"ContainerStarted","Data":"78331ce84efb4d01199b677e781791fb59cf16305669d60ecf064b20f68a52ff"} Nov 04 02:06:48.155376 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.155330 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:48.155489 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.155403 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:48.155489 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.155437 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:48.155489 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.155457 2562 scope.go:122] "RemoveContainer" containerID="952552fef87ebfd2bc61ca5b60bb5ee93b6cec74d8ccc8c32f3bbdb51e9b629e" Nov 04 02:06:48.171400 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.171379 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:48.171643 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.171626 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:06:48.975301 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.975251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:48.975301 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.975304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:48.975503 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:48.975393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:48.975503 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:48.975399 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:48.975503 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:48.975456 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:48.975610 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:48.975511 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:49.161439 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:49.161416 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:06:49.161875 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:49.161806 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" event={"ID":"1b432d50-c888-420f-980f-4e7dd474a44a","Type":"ContainerStarted","Data":"327dc911866e3fdd430768a5cd55ac0f310cea006841aff964194a68f037847a"} Nov 04 02:06:49.307512 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:49.292104 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" podStartSLOduration=7.345084684 podStartE2EDuration="27.292087565s" totalImagesPullingTime="19.947002881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:06:49.291723972 +0000 UTC m=+45.800507520" watchObservedRunningTime="2026-11-04 02:06:49.292087565 +0000 UTC m=+45.800871113" Nov 04 02:06:50.681171 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:50.681142 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ftvnd"] Nov 04 02:06:50.681703 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:50.681237 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:50.681703 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:50.681343 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:50.684369 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:50.684343 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrp97"] Nov 04 02:06:50.684500 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:50.684444 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:50.684561 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:50.684534 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:50.684957 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:50.684941 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm28p"] Nov 04 02:06:50.685019 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:50.685009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:50.685094 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:50.685079 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:51.974734 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:51.974702 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:51.975321 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:51.974818 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:51.975321 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:51.974868 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:51.975321 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:51.974955 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:52.974362 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:52.974336 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:52.974512 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:52.974429 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:53.975948 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:53.975918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:53.976352 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:53.976043 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:53.976352 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:53.976050 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:53.976352 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:53.976119 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:54.491897 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:54.491866 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:54.492059 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:54.491988 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:54.492059 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:54.492045 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret podName:c7cc9b6d-5ad9-4c08-b523-acee6c40a031 nodeName:}" failed. No retries permitted until 2026-11-04 02:07:26.492031317 +0000 UTC m=+83.000814857 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret") pod "global-pull-secret-syncer-ftvnd" (UID: "c7cc9b6d-5ad9-4c08-b523-acee6c40a031") : object "kube-system"/"original-pull-secret" not registered Nov 04 02:06:54.693852 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:54.693824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:54.693997 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:54.693934 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:54.693997 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:54.693982 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs podName:2cbe4ad0-7162-4e44-af92-3a3449226a55 nodeName:}" failed. No retries permitted until 2026-11-04 02:07:26.693970379 +0000 UTC m=+83.202753918 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs") pod "network-metrics-daemon-rm28p" (UID: "2cbe4ad0-7162-4e44-af92-3a3449226a55") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 02:06:54.794847 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:54.794783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:54.794964 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:54.794904 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 02:06:54.794964 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:54.794919 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 02:06:54.794964 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:54.794928 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hd962 for pod openshift-network-diagnostics/network-check-target-wrp97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:54.795053 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:54.794971 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962 podName:a50b6ca7-2a42-4dff-a86e-0e73749997cc nodeName:}" failed. No retries permitted until 2026-11-04 02:07:26.794959254 +0000 UTC m=+83.303742780 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd962" (UniqueName: "kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962") pod "network-check-target-wrp97" (UID: "a50b6ca7-2a42-4dff-a86e-0e73749997cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 02:06:54.974680 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:54.974649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:54.974831 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:54.974763 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:55.974964 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:55.974937 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:55.974964 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:55.974952 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:55.975383 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:55.975041 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvnd" podUID="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" Nov 04 02:06:55.975383 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:55.975201 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm28p" podUID="2cbe4ad0-7162-4e44-af92-3a3449226a55" Nov 04 02:06:56.974610 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:56.974586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:56.974743 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:06:56.974674 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrp97" podUID="a50b6ca7-2a42-4dff-a86e-0e73749997cc" Nov 04 02:06:57.258433 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.258406 2562 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeReady" Nov 04 02:06:57.258758 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.258500 2562 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 04 02:06:57.374543 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.374501 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2zhl2"] Nov 04 02:06:57.376796 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.376771 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.424067 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.424031 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8f6tb"] Nov 04 02:06:57.426264 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.426249 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jlmzj"] Nov 04 02:06:57.426391 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.426375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.427900 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.427887 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:06:57.429503 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.429481 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 02:06:57.429597 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.429575 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 02:06:57.429652 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.429615 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pzhlz\"" Nov 04 02:06:57.461400 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.461379 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2zhl2"] Nov 04 02:06:57.487896 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.487877 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8f6tb"] Nov 04 02:06:57.508713 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.508663 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 02:06:57.508964 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.508939 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 02:06:57.509050 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.508970 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 02:06:57.509050 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.508971 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 02:06:57.509050 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.508995 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 02:06:57.516626 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f908d57-06d5-4d74-9044-b3e045c36806-data-volume\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.516699 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nm8q\" (UniqueName: \"kubernetes.io/projected/7f908d57-06d5-4d74-9044-b3e045c36806-kube-api-access-4nm8q\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.516699 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516655 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f908d57-06d5-4d74-9044-b3e045c36806-crio-socket\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.516770 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-tmp-dir\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.516770 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516757 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbqtw\" (UniqueName: \"kubernetes.io/projected/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-kube-api-access-bbqtw\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.516832 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23de7dd-cf78-4151-82bb-1b0c770b1189-cert\") pod \"ingress-canary-jlmzj\" (UID: \"a23de7dd-cf78-4151-82bb-1b0c770b1189\") " pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:06:57.516832 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsvc4\" (UniqueName: \"kubernetes.io/projected/a23de7dd-cf78-4151-82bb-1b0c770b1189-kube-api-access-wsvc4\") pod \"ingress-canary-jlmzj\" (UID: \"a23de7dd-cf78-4151-82bb-1b0c770b1189\") " pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:06:57.516886 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f908d57-06d5-4d74-9044-b3e045c36806-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.516918 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-config-volume\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.516918 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-metrics-tls\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.516971 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.516948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f908d57-06d5-4d74-9044-b3e045c36806-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.524266 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.524248 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jlmzj"] Nov 04 02:06:57.529759 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.529741 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 02:06:57.529940 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.529924 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 02:06:57.530012 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.529939 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j7wvp\"" Nov 04 02:06:57.530012 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.529951 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-zd6qr\"" Nov 04 02:06:57.617707 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.617684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f908d57-06d5-4d74-9044-b3e045c36806-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.617796 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.617708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-config-volume\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.617796 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.617724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-metrics-tls\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.617796 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.617743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f908d57-06d5-4d74-9044-b3e045c36806-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.617908 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.617831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f908d57-06d5-4d74-9044-b3e045c36806-data-volume\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.617908 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.617861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nm8q\" (UniqueName: \"kubernetes.io/projected/7f908d57-06d5-4d74-9044-b3e045c36806-kube-api-access-4nm8q\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.617908 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.617897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f908d57-06d5-4d74-9044-b3e045c36806-crio-socket\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.618026 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.617937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-tmp-dir\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.618026 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.617962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbqtw\" (UniqueName: \"kubernetes.io/projected/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-kube-api-access-bbqtw\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.618026 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.617988 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23de7dd-cf78-4151-82bb-1b0c770b1189-cert\") pod \"ingress-canary-jlmzj\" (UID: \"a23de7dd-cf78-4151-82bb-1b0c770b1189\") " pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:06:57.618026 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.618011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsvc4\" (UniqueName: \"kubernetes.io/projected/a23de7dd-cf78-4151-82bb-1b0c770b1189-kube-api-access-wsvc4\") pod \"ingress-canary-jlmzj\" (UID: \"a23de7dd-cf78-4151-82bb-1b0c770b1189\") " pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:06:57.618210 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.618187 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f908d57-06d5-4d74-9044-b3e045c36806-crio-socket\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.618428 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.618406 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-tmp-dir\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.618508 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.618478 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f908d57-06d5-4d74-9044-b3e045c36806-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.618508 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.618483 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-config-volume\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.618646 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.618621 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f908d57-06d5-4d74-9044-b3e045c36806-data-volume\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.621385 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.621365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f908d57-06d5-4d74-9044-b3e045c36806-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.621460 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.621404 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23de7dd-cf78-4151-82bb-1b0c770b1189-cert\") pod \"ingress-canary-jlmzj\" (UID: \"a23de7dd-cf78-4151-82bb-1b0c770b1189\") " pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:06:57.621460 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.621413 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-metrics-tls\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.678657 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.678641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsvc4\" (UniqueName: \"kubernetes.io/projected/a23de7dd-cf78-4151-82bb-1b0c770b1189-kube-api-access-wsvc4\") pod \"ingress-canary-jlmzj\" (UID: \"a23de7dd-cf78-4151-82bb-1b0c770b1189\") " pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:06:57.678749 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.678728 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbqtw\" (UniqueName: \"kubernetes.io/projected/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-kube-api-access-bbqtw\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.678813 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.678795 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nm8q\" (UniqueName: \"kubernetes.io/projected/7f908d57-06d5-4d74-9044-b3e045c36806-kube-api-access-4nm8q\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.688646 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.688629 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2zhl2" Nov 04 02:06:57.739122 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.739078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:06:57.740746 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.740723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:06:57.974992 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.974967 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:06:57.975148 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:57.975131 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:06:58.027474 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.027452 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-ghp2x\"" Nov 04 02:06:58.027627 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.027561 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 02:06:58.027627 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.027595 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 02:06:58.027716 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.027625 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h9jgb\"" Nov 04 02:06:58.067713 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.067656 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2zhl2"] Nov 04 02:06:58.071046 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:58.071026 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a3ab36_e89b_4428_ad86_ab439ef4ca6a.slice/crio-17b4b8279df44dce4038f0546f718199b8bfbbefeff3a84e1741db44a222d8a7 WatchSource:0}: Error finding container 17b4b8279df44dce4038f0546f718199b8bfbbefeff3a84e1741db44a222d8a7: Status 404 returned error can't find the container with id 17b4b8279df44dce4038f0546f718199b8bfbbefeff3a84e1741db44a222d8a7 Nov 04 02:06:58.121735 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.121710 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8f6tb"] Nov 04 02:06:58.124888 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:58.124869 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f908d57_06d5_4d74_9044_b3e045c36806.slice/crio-cf43fb88af810e6a80939382127bf30510671ec63d26d81b09fbbf617c64bbcb WatchSource:0}: Error finding container cf43fb88af810e6a80939382127bf30510671ec63d26d81b09fbbf617c64bbcb: Status 404 returned error can't find the container with id cf43fb88af810e6a80939382127bf30510671ec63d26d81b09fbbf617c64bbcb Nov 04 02:06:58.170670 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.170648 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jlmzj"] Nov 04 02:06:58.175819 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:06:58.175785 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23de7dd_cf78_4151_82bb_1b0c770b1189.slice/crio-3b8a95d9acd48d7bee86458fbf01c69dc74ddd09a6b1601b4a4b425e5578511e WatchSource:0}: Error finding container 3b8a95d9acd48d7bee86458fbf01c69dc74ddd09a6b1601b4a4b425e5578511e: Status 404 returned error can't find the container with id 3b8a95d9acd48d7bee86458fbf01c69dc74ddd09a6b1601b4a4b425e5578511e Nov 04 02:06:58.182030 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.182009 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jlmzj" event={"ID":"a23de7dd-cf78-4151-82bb-1b0c770b1189","Type":"ContainerStarted","Data":"3b8a95d9acd48d7bee86458fbf01c69dc74ddd09a6b1601b4a4b425e5578511e"} Nov 04 02:06:58.183097 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.183073 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2zhl2" event={"ID":"41a3ab36-e89b-4428-ad86-ab439ef4ca6a","Type":"ContainerStarted","Data":"17b4b8279df44dce4038f0546f718199b8bfbbefeff3a84e1741db44a222d8a7"} Nov 04 02:06:58.184504 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.184484 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8f6tb" event={"ID":"7f908d57-06d5-4d74-9044-b3e045c36806","Type":"ContainerStarted","Data":"b8c5bd81c9677b880517deb8be353766f1bdd4f8b976a72c4ce9964b48d3676d"} Nov 04 02:06:58.184578 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.184528 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8f6tb" event={"ID":"7f908d57-06d5-4d74-9044-b3e045c36806","Type":"ContainerStarted","Data":"cf43fb88af810e6a80939382127bf30510671ec63d26d81b09fbbf617c64bbcb"} Nov 04 02:06:58.974870 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:58.974672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:06:59.027412 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:59.027374 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 02:06:59.027546 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:59.027447 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 02:06:59.027546 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:06:59.027467 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-8fdm8\"" Nov 04 02:07:00.192860 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:00.192828 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8f6tb" event={"ID":"7f908d57-06d5-4d74-9044-b3e045c36806","Type":"ContainerStarted","Data":"a8bf9a6ff523669a9c8318174f0e040a908d75119c530194e5ee9042606d45c9"} Nov 04 02:07:01.197763 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:01.197733 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2zhl2" event={"ID":"41a3ab36-e89b-4428-ad86-ab439ef4ca6a","Type":"ContainerStarted","Data":"221a48e8147dafb498e8b7e96bc1f6417b96affb8bfd125d0ce2257d48e4bb4a"} Nov 04 02:07:01.198446 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:01.197788 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2zhl2" event={"ID":"41a3ab36-e89b-4428-ad86-ab439ef4ca6a","Type":"ContainerStarted","Data":"640d872d1375c6172693a894ce2dda63c3ab9a6c59d5d728bad16cca6e701cdc"} Nov 04 02:07:01.198446 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:01.197854 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:01.199876 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:01.199857 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8f6tb" event={"ID":"7f908d57-06d5-4d74-9044-b3e045c36806","Type":"ContainerStarted","Data":"ffc4c0f24de5979b8c14516bae0b8e6f1232369dbcea37846ec651197b79652e"} Nov 04 02:07:01.324878 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:01.324829 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-2zhl2" podStartSLOduration=1.590459013 podStartE2EDuration="4.324815357s" totalImagesPullingTime="2.734356344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:07:01.323715327 +0000 UTC m=+57.832498876" watchObservedRunningTime="2026-11-04 02:07:01.324815357 +0000 UTC m=+57.833598904" Nov 04 02:07:01.442316 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:01.442247 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8f6tb" podStartSLOduration=1.579589979 podStartE2EDuration="4.442231087s" totalImagesPullingTime="2.862641108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:07:01.440909947 +0000 UTC m=+57.949693500" watchObservedRunningTime="2026-11-04 02:07:01.442231087 +0000 UTC m=+57.951014635" Nov 04 02:07:04.212512 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:04.212325 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jlmzj" event={"ID":"a23de7dd-cf78-4151-82bb-1b0c770b1189","Type":"ContainerStarted","Data":"6f417d9dfb1704b9d0cba25c34ab5ee8a9ad806205171e93332ac2e35f620159"} Nov 04 02:07:04.327201 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:04.327061 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jlmzj" podStartSLOduration=1.790475223 podStartE2EDuration="7.32704595s" totalImagesPullingTime="5.536570727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:07:04.326769169 +0000 UTC m=+60.835552716" watchObservedRunningTime="2026-11-04 02:07:04.32704595 +0000 UTC m=+60.835829499" Nov 04 02:07:11.207386 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:11.207359 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:20.174744 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:20.174716 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:21.829937 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.829909 2562 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 02:07:21.834420 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.834404 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.886988 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.886969 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 04 02:07:21.936391 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.936368 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 04 02:07:21.936519 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.936375 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 04 02:07:21.936519 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.936373 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 04 02:07:21.936519 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.936410 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 04 02:07:21.936519 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.936416 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 04 02:07:21.936519 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.936433 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 04 02:07:21.936519 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.936518 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fjjw2\"" Nov 04 02:07:21.937738 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.937719 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brwf6\" (UniqueName: \"kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-kube-api-access-brwf6\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-out\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987415 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-web-config\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987636 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:21.990028 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:21.987681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.036069 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.036040 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 04 02:07:22.036168 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.036111 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 04 02:07:22.088502 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088502 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088643 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088643 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088643 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-web-config\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088643 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088605 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088643 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088879 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088689 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088879 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brwf6\" (UniqueName: \"kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-kube-api-access-brwf6\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088879 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088879 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088755 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-out\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088879 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.088879 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.089171 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.088959 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.090360 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.089610 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.090360 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.090099 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.093586 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.093560 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.093804 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.093778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.093880 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.093869 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-web-config\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.093929 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.093880 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.093929 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.093871 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.094066 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.094052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.094226 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.094210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.094342 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.094322 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.094867 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.094853 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-out\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.150363 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.150343 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brwf6\" (UniqueName: \"kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-kube-api-access-brwf6\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.450019 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.450000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:22.929411 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:22.929379 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 02:07:22.933422 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:07:22.933400 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61936444_21d0_45a0_b2b2_57cdcd514f3a.slice/crio-4b9a9dfcaffb06327692c42db736b89c8ae10f099565830328a52d3139491f1a WatchSource:0}: Error finding container 4b9a9dfcaffb06327692c42db736b89c8ae10f099565830328a52d3139491f1a: Status 404 returned error can't find the container with id 4b9a9dfcaffb06327692c42db736b89c8ae10f099565830328a52d3139491f1a Nov 04 02:07:23.265100 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:23.265041 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61936444-21d0-45a0-b2b2-57cdcd514f3a","Type":"ContainerStarted","Data":"4b9a9dfcaffb06327692c42db736b89c8ae10f099565830328a52d3139491f1a"} Nov 04 02:07:25.272808 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:25.272773 2562 generic.go:356] "Generic (PLEG): container finished" podID="61936444-21d0-45a0-b2b2-57cdcd514f3a" containerID="c47b28b998a980b8081e4ae1afcceaa70b1cb7f3dfeeb91f62ab8809ae256bce" exitCode=0 Nov 04 02:07:25.273165 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:25.272819 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61936444-21d0-45a0-b2b2-57cdcd514f3a","Type":"ContainerDied","Data":"c47b28b998a980b8081e4ae1afcceaa70b1cb7f3dfeeb91f62ab8809ae256bce"} Nov 04 02:07:26.529231 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.529202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:26.580272 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.580230 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 02:07:26.591936 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.591908 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:26.731270 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.731243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:07:26.782847 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.782777 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 02:07:26.794589 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.794562 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:07:26.832319 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.832274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:07:26.840994 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.840966 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-ghp2x\"" Nov 04 02:07:26.850674 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.850654 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:26.883468 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.883443 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 02:07:26.944026 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.943999 2562 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 02:07:26.955594 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:26.955571 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:07:27.139617 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:27.139599 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h9jgb\"" Nov 04 02:07:27.148582 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:27.148561 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:07:27.223934 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:27.223912 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ftvnd"] Nov 04 02:07:27.232227 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:07:27.232202 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7cc9b6d_5ad9_4c08_b523_acee6c40a031.slice/crio-fef881a2dcdf170d7452304e726477c4c5d6d36abcd45f8e4d480a30f383cbcf WatchSource:0}: Error finding container fef881a2dcdf170d7452304e726477c4c5d6d36abcd45f8e4d480a30f383cbcf: Status 404 returned error can't find the container with id fef881a2dcdf170d7452304e726477c4c5d6d36abcd45f8e4d480a30f383cbcf Nov 04 02:07:27.236957 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:27.236940 2562 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-8fdm8\"" Nov 04 02:07:27.245953 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:27.245934 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:07:27.280956 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:27.280933 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61936444-21d0-45a0-b2b2-57cdcd514f3a","Type":"ContainerStarted","Data":"c007a503f88fd243792aaa13505e4da486a5def647e193bb97dda0e1843a49f5"} Nov 04 02:07:27.281048 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:27.281016 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61936444-21d0-45a0-b2b2-57cdcd514f3a","Type":"ContainerStarted","Data":"bf6784937aa56152de25c868cad6ba6f038839409c40ddc00f83821e983a9d13"} Nov 04 02:07:27.281950 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:27.281917 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ftvnd" event={"ID":"c7cc9b6d-5ad9-4c08-b523-acee6c40a031","Type":"ContainerStarted","Data":"fef881a2dcdf170d7452304e726477c4c5d6d36abcd45f8e4d480a30f383cbcf"} Nov 04 02:07:27.524622 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:27.524594 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm28p"] Nov 04 02:07:27.527983 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:07:27.527961 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cbe4ad0_7162_4e44_af92_3a3449226a55.slice/crio-4eb0726311624a64c819e43cc2184634c654570d28b2b8cc6e66af76958400cd WatchSource:0}: Error finding container 4eb0726311624a64c819e43cc2184634c654570d28b2b8cc6e66af76958400cd: Status 404 returned error can't find the container with id 4eb0726311624a64c819e43cc2184634c654570d28b2b8cc6e66af76958400cd Nov 04 02:07:27.620541 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:27.620515 2562 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrp97"] Nov 04 02:07:27.626886 ip-10-0-135-225 kubenswrapper[2562]: W1104 02:07:27.626867 2562 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50b6ca7_2a42_4dff_a86e_0e73749997cc.slice/crio-1aa394d33066277b5090cb98550f2ecf1893decab986a8ed73bfd797e6eb8808 WatchSource:0}: Error finding container 1aa394d33066277b5090cb98550f2ecf1893decab986a8ed73bfd797e6eb8808: Status 404 returned error can't find the container with id 1aa394d33066277b5090cb98550f2ecf1893decab986a8ed73bfd797e6eb8808 Nov 04 02:07:27.765834 ip-10-0-135-225 kubenswrapper[2562]: E1104 02:07:27.765799 2562 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:07:28.288461 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:28.288432 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61936444-21d0-45a0-b2b2-57cdcd514f3a","Type":"ContainerStarted","Data":"8739c81c38b1bba05cf2eb5c465a145b031bd817a9cfee3a01ebe4088a72f8e5"} Nov 04 02:07:28.288612 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:28.288502 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61936444-21d0-45a0-b2b2-57cdcd514f3a","Type":"ContainerStarted","Data":"9a64b1303332a4ccf658410b89e5e46d80f912a26ae6597558c07b663f172a40"} Nov 04 02:07:28.288612 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:28.288542 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61936444-21d0-45a0-b2b2-57cdcd514f3a","Type":"ContainerStarted","Data":"0bbdf417fa85c26b091c565ed6eabc15a8cc775acfa3ca285f57ad3fed01014a"} Nov 04 02:07:28.289741 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:28.289714 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrp97" event={"ID":"a50b6ca7-2a42-4dff-a86e-0e73749997cc","Type":"ContainerStarted","Data":"1aa394d33066277b5090cb98550f2ecf1893decab986a8ed73bfd797e6eb8808"} Nov 04 02:07:28.290886 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:28.290863 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm28p" event={"ID":"2cbe4ad0-7162-4e44-af92-3a3449226a55","Type":"ContainerStarted","Data":"4eb0726311624a64c819e43cc2184634c654570d28b2b8cc6e66af76958400cd"} Nov 04 02:07:29.299758 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:29.299721 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61936444-21d0-45a0-b2b2-57cdcd514f3a","Type":"ContainerStarted","Data":"00ae8cb04a349554466be06e60b7635c2ff07ff3e20db2f4fa3da62bddf41942"} Nov 04 02:07:29.579949 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:29.579015 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.120518443 podStartE2EDuration="8.578996999s" totalImagesPullingTime="4.447442283s" totalInitContainerRuntime="11.036273ms" isStatefulPod=false podCreationTimestamp="2026-11-04 02:07:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:07:29.528696198 +0000 UTC m=+86.037479772" watchObservedRunningTime="2026-11-04 02:07:29.578996999 +0000 UTC m=+86.087780549" Nov 04 02:07:30.306084 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:30.306051 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm28p" event={"ID":"2cbe4ad0-7162-4e44-af92-3a3449226a55","Type":"ContainerStarted","Data":"ed25d67cb90a4ab95d2176cae654d2b498fcba77473cfdccf8b3b219cca32853"} Nov 04 02:07:30.306553 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:30.306108 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm28p" event={"ID":"2cbe4ad0-7162-4e44-af92-3a3449226a55","Type":"ContainerStarted","Data":"8d09416fdadb57805e4224ba10f5e5af1c49038ea402f144d68d3b1afbdae54b"} Nov 04 02:07:30.422695 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:30.422633 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rm28p" podStartSLOduration=66.040637002 podStartE2EDuration="1m8.42261509s" totalImagesPullingTime="2.381978088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:07:30.421493114 +0000 UTC m=+86.930276665" watchObservedRunningTime="2026-11-04 02:07:30.42261509 +0000 UTC m=+86.931398639" Nov 04 02:07:32.318127 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:32.318055 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrp97" event={"ID":"a50b6ca7-2a42-4dff-a86e-0e73749997cc","Type":"ContainerStarted","Data":"4caf20798934725e209792efe0923aedc3ec80a8aa8cdf3e1a753ad34e8fbc55"} Nov 04 02:07:32.318482 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:32.318178 2562 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:07:32.432244 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:32.432205 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wrp97" podStartSLOduration=66.108557656 podStartE2EDuration="1m10.432193886s" totalImagesPullingTime="4.32363623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:07:32.43217073 +0000 UTC m=+88.940954278" watchObservedRunningTime="2026-11-04 02:07:32.432193886 +0000 UTC m=+88.940977430" Nov 04 02:07:34.326624 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:34.326595 2562 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ftvnd" event={"ID":"c7cc9b6d-5ad9-4c08-b523-acee6c40a031","Type":"ContainerStarted","Data":"93357f7a193152b3788a5c619f420ead9a50bdd3ab3f782c4ca48bb7f6daa710"} Nov 04 02:07:34.441273 ip-10-0-135-225 kubenswrapper[2562]: I1104 02:07:34.441208 2562 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ftvnd" podStartSLOduration=65.475686224 podStartE2EDuration="1m12.441190971s" totalImagesPullingTime="6.965504747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:07:34.440186515 +0000 UTC m=+90.948970062" watchObservedRunningTime="2026-11-04 02:07:34.441190971 +0000 UTC m=+90.949974521" Nov 04 02:07:34.441440 ip-10-0-135-225 systemd[1]: Stopping Kubernetes Kubelet... Nov 04 02:07:34.463630 ip-10-0-135-225 systemd[1]: kubelet.service: Deactivated successfully. Nov 04 02:07:34.463796 ip-10-0-135-225 systemd[1]: Stopped Kubernetes Kubelet. Nov 04 02:07:34.463959 ip-10-0-135-225 systemd[1]: kubelet.service: Consumed 3.814s CPU time. Nov 04 02:07:34.480917 ip-10-0-135-225 systemd[1]: Starting Kubernetes Kubelet... Nov 04 02:07:34.539104 ip-10-0-135-225 kubenswrapper[5219]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 02:07:34.539104 ip-10-0-135-225 kubenswrapper[5219]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 02:07:34.539104 ip-10-0-135-225 kubenswrapper[5219]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 02:07:34.539590 ip-10-0-135-225 kubenswrapper[5219]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 02:07:34.541045 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.540976 5219 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:07:34.541045 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541045 5219 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541049 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541052 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541055 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541058 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541060 5219 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541063 5219 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541066 5219 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541069 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541071 5219 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541074 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541076 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541079 5219 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541081 5219 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541084 5219 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541086 5219 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541088 5219 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541091 5219 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541093 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:07:34.541104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541095 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541098 5219 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541100 5219 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541103 5219 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541106 5219 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541109 5219 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541111 5219 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541114 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541116 5219 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541119 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541121 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541124 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541126 5219 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541129 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541131 5219 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541133 5219 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541136 5219 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541138 5219 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541140 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541143 5219 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:07:34.541611 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541146 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541148 5219 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541151 5219 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541153 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541155 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541168 5219 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541173 5219 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541176 5219 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541179 5219 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541182 5219 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541184 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541187 5219 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541190 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541192 5219 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541195 5219 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541197 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541200 5219 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541202 5219 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541205 5219 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:07:34.542079 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541207 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541209 5219 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541213 5219 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541216 5219 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541219 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541222 5219 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541224 5219 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541227 5219 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541230 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541232 5219 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541235 5219 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541237 5219 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541240 5219 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541244 5219 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541247 5219 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541249 5219 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541252 5219 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541254 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541257 5219 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541259 5219 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:07:34.542546 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541262 5219 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541264 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541267 5219 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541269 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541272 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541274 5219 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541277 5219 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541279 5219 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541295 5219 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541298 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541301 5219 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541303 5219 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541306 5219 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541308 5219 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541310 5219 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541313 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541315 5219 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541318 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541320 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541323 5219 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:07:34.543012 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541325 5219 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541328 5219 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541330 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541333 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541335 5219 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541338 5219 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.541348 5219 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542180 5219 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542187 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542191 5219 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542196 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542199 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542202 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542205 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542207 5219 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542210 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542212 5219 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542215 5219 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542217 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:07:34.543490 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542220 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542223 5219 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542225 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542227 5219 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542230 5219 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542232 5219 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542235 5219 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542237 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542239 5219 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542242 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542244 5219 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542247 5219 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542250 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542252 5219 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542255 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542257 5219 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542260 5219 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542263 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542265 5219 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542268 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:07:34.543931 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542276 5219 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542280 5219 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542299 5219 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542303 5219 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542305 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542308 5219 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542310 5219 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542313 5219 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542315 5219 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542318 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542321 5219 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542323 5219 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542325 5219 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542328 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542330 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542333 5219 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542335 5219 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542338 5219 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542340 5219 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:07:34.544425 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542343 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542346 5219 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542348 5219 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542351 5219 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542353 5219 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542357 5219 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542361 5219 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542364 5219 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542367 5219 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542369 5219 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542372 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542374 5219 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542376 5219 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542379 5219 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542387 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542390 5219 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542392 5219 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542395 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542397 5219 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:07:34.544865 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542399 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542402 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542404 5219 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542407 5219 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542409 5219 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542412 5219 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542415 5219 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542418 5219 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542420 5219 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542422 5219 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542425 5219 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542428 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542430 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542433 5219 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542435 5219 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542438 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542440 5219 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542443 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542445 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542447 5219 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:07:34.545347 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542450 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542453 5219 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542455 5219 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542457 5219 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542460 5219 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542462 5219 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542465 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542467 5219 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542475 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542478 5219 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542481 5219 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542483 5219 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542486 5219 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542489 5219 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542491 5219 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.542494 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543034 5219 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543039 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543042 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:07:34.545828 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543044 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543047 5219 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543050 5219 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543052 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543055 5219 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543057 5219 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543060 5219 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543063 5219 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543065 5219 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543068 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543071 5219 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543074 5219 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543077 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543080 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543082 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543085 5219 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543087 5219 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543089 5219 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543093 5219 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:07:34.546318 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543096 5219 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543099 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543108 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543122 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543126 5219 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543129 5219 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543132 5219 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543134 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543137 5219 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543139 5219 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543142 5219 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543144 5219 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543146 5219 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543151 5219 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543153 5219 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543156 5219 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543159 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543161 5219 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543163 5219 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543166 5219 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:07:34.546851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543168 5219 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543171 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543173 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543175 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543178 5219 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543180 5219 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543182 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543186 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543188 5219 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543190 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543193 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543195 5219 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543197 5219 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543200 5219 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543202 5219 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543210 5219 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543213 5219 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543215 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543218 5219 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:07:34.547729 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543220 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543223 5219 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543225 5219 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543228 5219 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543230 5219 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543232 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543236 5219 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543239 5219 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543241 5219 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543244 5219 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543246 5219 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543249 5219 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543251 5219 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543254 5219 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543256 5219 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543258 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543261 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543263 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543266 5219 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:07:34.548534 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543268 5219 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543270 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543273 5219 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543275 5219 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543278 5219 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543280 5219 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543297 5219 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543300 5219 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543302 5219 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543305 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543316 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543319 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543321 5219 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543324 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543327 5219 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543330 5219 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543332 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543335 5219 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543337 5219 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:07:34.549376 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543341 5219 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543343 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543346 5219 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543348 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543351 5219 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543353 5219 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.543356 5219 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543450 5219 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543461 5219 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543478 5219 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543484 5219 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543489 5219 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543492 5219 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543496 5219 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543500 5219 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543503 5219 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543506 5219 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543509 5219 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543512 5219 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543515 5219 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543518 5219 flags.go:64] FLAG: --cgroup-root="" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543520 5219 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543523 5219 flags.go:64] FLAG: --client-ca-file="" Nov 04 02:07:34.550130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543526 5219 flags.go:64] FLAG: --cloud-provider="external" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543536 5219 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543543 5219 flags.go:64] FLAG: --cluster-domain="" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543546 5219 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543550 5219 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543553 5219 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543557 5219 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543561 5219 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543564 5219 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543567 5219 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543570 5219 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543573 5219 flags.go:64] FLAG: --contention-profiling="false" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543576 5219 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543579 5219 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543582 5219 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543584 5219 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543589 5219 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543591 5219 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543594 5219 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543597 5219 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543599 5219 flags.go:64] FLAG: --enable-server="true" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543602 5219 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543609 5219 flags.go:64] FLAG: --event-burst="100" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543611 5219 flags.go:64] FLAG: --event-qps="50" Nov 04 02:07:34.550991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543614 5219 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543617 5219 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543620 5219 flags.go:64] FLAG: --eviction-hard="" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543623 5219 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543626 5219 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543629 5219 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543632 5219 flags.go:64] FLAG: --eviction-soft="" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543635 5219 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543637 5219 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543640 5219 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543649 5219 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543652 5219 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543655 5219 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543658 5219 flags.go:64] FLAG: --feature-gates="" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543662 5219 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543665 5219 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543668 5219 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543671 5219 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543674 5219 flags.go:64] FLAG: --healthz-port="10248" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543677 5219 flags.go:64] FLAG: --help="false" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543680 5219 flags.go:64] FLAG: --hostname-override="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543683 5219 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543687 5219 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 02:07:34.551643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543690 5219 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543693 5219 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543697 5219 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543699 5219 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543702 5219 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543705 5219 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543708 5219 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543711 5219 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543714 5219 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543717 5219 flags.go:64] FLAG: --kube-reserved="" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543720 5219 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543722 5219 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543725 5219 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543728 5219 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543731 5219 flags.go:64] FLAG: --lock-file="" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543733 5219 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543736 5219 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543739 5219 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543744 5219 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543747 5219 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543750 5219 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543754 5219 flags.go:64] FLAG: --logging-format="text" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543757 5219 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543760 5219 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 02:07:34.552202 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543762 5219 flags.go:64] FLAG: --manifest-url="" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543765 5219 flags.go:64] FLAG: --manifest-url-header="" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543770 5219 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543773 5219 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543776 5219 flags.go:64] FLAG: --max-pods="110" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543779 5219 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543781 5219 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543784 5219 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543787 5219 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543790 5219 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543792 5219 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543795 5219 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543801 5219 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543804 5219 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543807 5219 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543809 5219 flags.go:64] FLAG: --pod-cidr="" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543812 5219 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543815 5219 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543818 5219 flags.go:64] FLAG: --pods-per-core="0" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543820 5219 flags.go:64] FLAG: --port="10250" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543823 5219 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543826 5219 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-017fd60c01f61f4b7" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543829 5219 flags.go:64] FLAG: --qos-reserved="" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543831 5219 flags.go:64] FLAG: --read-only-port="10255" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543834 5219 flags.go:64] FLAG: --register-node="true" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543837 5219 flags.go:64] FLAG: --register-with-taints="" Nov 04 02:07:34.552777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543841 5219 flags.go:64] FLAG: --registry-burst="10" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543844 5219 flags.go:64] FLAG: --registry-qps="5" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543846 5219 flags.go:64] FLAG: --reserved-cpus="" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543851 5219 flags.go:64] FLAG: --reserved-memory="" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543854 5219 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543857 5219 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543860 5219 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543863 5219 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543866 5219 flags.go:64] FLAG: --runonce="false" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543869 5219 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543871 5219 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543874 5219 flags.go:64] FLAG: --seccomp-default="false" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543877 5219 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543880 5219 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543883 5219 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543885 5219 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543888 5219 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543891 5219 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543894 5219 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543896 5219 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543899 5219 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543902 5219 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543905 5219 flags.go:64] FLAG: --system-cgroups="" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543907 5219 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543912 5219 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 02:07:34.553423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543915 5219 flags.go:64] FLAG: --tls-cert-file="" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543918 5219 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543921 5219 flags.go:64] FLAG: --tls-min-version="" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543924 5219 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543927 5219 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543929 5219 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543933 5219 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543936 5219 flags.go:64] FLAG: --v="2" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543941 5219 flags.go:64] FLAG: --version="false" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543944 5219 flags.go:64] FLAG: --vmodule="" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543949 5219 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.543952 5219 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544108 5219 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544112 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544115 5219 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544118 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544120 5219 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544122 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544125 5219 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544127 5219 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544130 5219 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544133 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544135 5219 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:07:34.553999 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544137 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544140 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544142 5219 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544145 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544147 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544149 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544152 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544154 5219 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544157 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544159 5219 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544161 5219 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544164 5219 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544166 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544168 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544171 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544174 5219 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544177 5219 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544179 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544182 5219 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544184 5219 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:07:34.554582 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544186 5219 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544189 5219 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544192 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544194 5219 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544196 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544199 5219 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544202 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544204 5219 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544207 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544209 5219 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544212 5219 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544214 5219 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544216 5219 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544219 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544221 5219 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544224 5219 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544226 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544229 5219 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544231 5219 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544233 5219 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:07:34.555233 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544236 5219 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544239 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544241 5219 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544243 5219 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544246 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544248 5219 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544252 5219 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544257 5219 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544260 5219 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544263 5219 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544265 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544268 5219 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544272 5219 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544275 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544278 5219 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544281 5219 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544297 5219 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544299 5219 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544302 5219 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:07:34.555911 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544304 5219 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544307 5219 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544309 5219 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544312 5219 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544314 5219 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544317 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544319 5219 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544322 5219 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544324 5219 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544327 5219 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544329 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544331 5219 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544334 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544336 5219 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544339 5219 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544341 5219 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544343 5219 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544346 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544348 5219 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:07:34.556373 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544350 5219 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544354 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544357 5219 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544359 5219 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544362 5219 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544364 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544367 5219 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544369 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544372 5219 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544375 5219 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544377 5219 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544380 5219 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544382 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544385 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544387 5219 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544390 5219 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:07:34.556822 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544392 5219 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.544417 5219 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544450 5219 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544454 5219 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544457 5219 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544462 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544464 5219 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544467 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544469 5219 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544472 5219 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544474 5219 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544477 5219 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544479 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544482 5219 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544484 5219 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544486 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:07:34.557223 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544490 5219 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544492 5219 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544495 5219 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544498 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544501 5219 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544503 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544506 5219 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544508 5219 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544511 5219 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544513 5219 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544516 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544518 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544521 5219 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544523 5219 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544526 5219 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544529 5219 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544531 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544533 5219 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544536 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544538 5219 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:07:34.557721 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544541 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544544 5219 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544547 5219 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544549 5219 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544552 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544554 5219 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544557 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544559 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544562 5219 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544564 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544566 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544569 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544571 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544574 5219 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544578 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544580 5219 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544583 5219 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544585 5219 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544587 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544590 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:07:34.558260 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544592 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544595 5219 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544597 5219 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544600 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544603 5219 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544605 5219 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544608 5219 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544610 5219 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544614 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544617 5219 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544621 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544625 5219 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544628 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544634 5219 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544638 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544641 5219 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544644 5219 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544646 5219 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544649 5219 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544651 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:07:34.558747 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544654 5219 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544656 5219 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544659 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544661 5219 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544663 5219 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544666 5219 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544669 5219 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544672 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544675 5219 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544677 5219 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544679 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544682 5219 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544686 5219 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544691 5219 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544693 5219 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544696 5219 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544699 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544702 5219 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:07:34.559210 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544706 5219 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544709 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544712 5219 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544714 5219 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544717 5219 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544719 5219 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544722 5219 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544726 5219 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544728 5219 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544731 5219 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544733 5219 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544736 5219 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544739 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.544742 5219 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.548982 5219 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.548998 5219 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.549020 5219 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.549028 5219 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549111 5219 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549118 5219 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:07:34.559705 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549123 5219 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549127 5219 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549131 5219 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549135 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549140 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549145 5219 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549149 5219 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549153 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549164 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549171 5219 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549178 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549184 5219 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549189 5219 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549193 5219 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549197 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549201 5219 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549205 5219 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549209 5219 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549213 5219 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:07:34.560179 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549217 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549221 5219 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549225 5219 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549229 5219 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549234 5219 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549238 5219 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549242 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549246 5219 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549250 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549255 5219 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549259 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549263 5219 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549267 5219 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549271 5219 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549275 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549279 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549300 5219 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549305 5219 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549309 5219 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549313 5219 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:07:34.560636 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549317 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549322 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549325 5219 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549329 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549335 5219 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549339 5219 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549343 5219 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549347 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549351 5219 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549355 5219 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549359 5219 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549363 5219 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549367 5219 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549371 5219 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549375 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549379 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549383 5219 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549387 5219 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549391 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549394 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:07:34.561133 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549398 5219 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549402 5219 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549406 5219 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549410 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549414 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549418 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549422 5219 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549426 5219 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549432 5219 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549438 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549442 5219 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549446 5219 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549450 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549454 5219 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549458 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549463 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549467 5219 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549472 5219 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549476 5219 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:07:34.561637 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549480 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549484 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549488 5219 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549492 5219 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549496 5219 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549500 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549504 5219 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549508 5219 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549512 5219 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549516 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549520 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549524 5219 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549528 5219 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549532 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549536 5219 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549540 5219 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549544 5219 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549548 5219 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549552 5219 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:07:34.562075 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549556 5219 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549560 5219 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549564 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549568 5219 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549572 5219 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549575 5219 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.549579 5219 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.549618 5219 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550210 5219 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550475 5219 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550480 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550484 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550490 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550496 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550500 5219 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550505 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:07:34.562529 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550509 5219 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550513 5219 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550518 5219 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550522 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550533 5219 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550540 5219 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550548 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550553 5219 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550557 5219 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550562 5219 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550566 5219 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550570 5219 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550574 5219 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550579 5219 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550583 5219 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550587 5219 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550597 5219 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550601 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550606 5219 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550610 5219 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:07:34.562907 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550614 5219 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550619 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550624 5219 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550628 5219 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550632 5219 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550637 5219 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550641 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550645 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550649 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550660 5219 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550665 5219 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550669 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550674 5219 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550678 5219 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550682 5219 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550686 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550690 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550694 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550698 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:07:34.563477 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550703 5219 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550707 5219 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550717 5219 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550722 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550726 5219 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550730 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550735 5219 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550739 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550743 5219 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550748 5219 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550752 5219 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550756 5219 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550768 5219 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550773 5219 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550777 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550787 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550791 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550795 5219 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550800 5219 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:07:34.563910 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550804 5219 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550808 5219 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550812 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550817 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550822 5219 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550826 5219 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550831 5219 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550835 5219 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550844 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550848 5219 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550853 5219 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550857 5219 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550861 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550865 5219 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550870 5219 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550874 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550878 5219 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550882 5219 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550889 5219 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550895 5219 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:07:34.564355 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550899 5219 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550908 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550913 5219 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550917 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550921 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550927 5219 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550931 5219 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550935 5219 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550940 5219 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550944 5219 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550948 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550952 5219 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550956 5219 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550961 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550970 5219 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550975 5219 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550979 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550984 5219 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550988 5219 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:07:34.564877 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.550992 5219 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.551091 5219 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551347 5219 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551354 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551358 5219 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551361 5219 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551364 5219 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551366 5219 feature_gate.go:386] unrecognized feature gate: Example Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551369 5219 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551371 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551374 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551376 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551380 5219 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551383 5219 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551385 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551388 5219 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 02:07:34.565615 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551390 5219 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551393 5219 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551396 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551399 5219 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551403 5219 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551407 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551412 5219 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551415 5219 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551418 5219 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551420 5219 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551423 5219 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551425 5219 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551428 5219 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551431 5219 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551433 5219 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551436 5219 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551439 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551441 5219 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551444 5219 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 02:07:34.566058 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551447 5219 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551451 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551453 5219 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551456 5219 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551458 5219 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551461 5219 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551463 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551466 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551468 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551471 5219 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551473 5219 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551476 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551478 5219 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551481 5219 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551483 5219 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551486 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551488 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551491 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551493 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 02:07:34.566560 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551495 5219 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551498 5219 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551500 5219 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551503 5219 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551506 5219 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551509 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551512 5219 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551515 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551518 5219 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551520 5219 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551523 5219 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551525 5219 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551528 5219 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551531 5219 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551533 5219 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551536 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551538 5219 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551540 5219 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551543 5219 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 02:07:34.567000 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551545 5219 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551548 5219 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551550 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551553 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551555 5219 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551558 5219 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551560 5219 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551563 5219 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551565 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551567 5219 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551570 5219 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551573 5219 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551575 5219 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551578 5219 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551580 5219 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551583 5219 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551586 5219 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551588 5219 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551594 5219 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551597 5219 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 02:07:34.567555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551600 5219 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551603 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551605 5219 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551607 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551610 5219 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551612 5219 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551614 5219 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551617 5219 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551619 5219 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551622 5219 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551625 5219 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551627 5219 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551630 5219 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551632 5219 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:07:34.551635 5219 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.551694 5219 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.552582 5219 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.552630 5219 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.552793 5219 server.go:1014] "Starting client certificate rotation" Nov 04 02:07:34.568299 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.552925 5219 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 02:07:34.568754 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.552976 5219 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 02:01:03 +0000 UTC" deadline="2028-07-27 07:56:38.202365862 +0000 UTC" Nov 04 02:07:34.568754 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.553004 5219 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15149h49m3.649364807s" Nov 04 02:07:34.568754 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.553216 5219 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 02:07:34.568754 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.554213 5219 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 02:07:34.568754 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.555353 5219 log.go:25] "Validated CRI v1 runtime API" Nov 04 02:07:34.568754 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.556914 5219 log.go:25] "Validated CRI v1 image API" Nov 04 02:07:34.568754 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.557641 5219 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 02:07:34.568754 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.559201 5219 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 88c361d9-e3a7-41f6-ac84-3afb2c888dca:/dev/nvme0n1p4 8d9d869e-6cc4-4989-bb68-d05b4c554844:/dev/nvme0n1p3] Nov 04 02:07:34.568957 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.559220 5219 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/02019e9df5a86d8332fd6ba93caa4e1eea89010481b8e639bdc96a98bb218c24/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/02019e9df5a86d8332fd6ba93caa4e1eea89010481b8e639bdc96a98bb218c24/userdata/shm major:0 minor:103 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f2a9234127298e19f33426c0282ecec0be0a2381d02f85fd3584a968689025d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f2a9234127298e19f33426c0282ecec0be0a2381d02f85fd3584a968689025d/userdata/shm major:0 minor:157 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/17b4b8279df44dce4038f0546f718199b8bfbbefeff3a84e1741db44a222d8a7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/17b4b8279df44dce4038f0546f718199b8bfbbefeff3a84e1741db44a222d8a7/userdata/shm major:0 minor:222 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1aa394d33066277b5090cb98550f2ecf1893decab986a8ed73bfd797e6eb8808/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1aa394d33066277b5090cb98550f2ecf1893decab986a8ed73bfd797e6eb8808/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/212ed90324864507066d142a48bdcecae5a06c03713bd53244554ca26f13a615/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/212ed90324864507066d142a48bdcecae5a06c03713bd53244554ca26f13a615/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3b8a95d9acd48d7bee86458fbf01c69dc74ddd09a6b1601b4a4b425e5578511e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3b8a95d9acd48d7bee86458fbf01c69dc74ddd09a6b1601b4a4b425e5578511e/userdata/shm major:0 minor:225 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3e4f3dd3f6b470ac1ccd9b9ddda16b7e3fcfc95e4d8e35774c62b008f48f1479/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3e4f3dd3f6b470ac1ccd9b9ddda16b7e3fcfc95e4d8e35774c62b008f48f1479/userdata/shm major:0 minor:95 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/49cb499320957b748a36b25248cfd3524ad4e557f5ac8c7f3dc438bb98d0f68c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/49cb499320957b748a36b25248cfd3524ad4e557f5ac8c7f3dc438bb98d0f68c/userdata/shm major:0 minor:69 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4b9a9dfcaffb06327692c42db736b89c8ae10f099565830328a52d3139491f1a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4b9a9dfcaffb06327692c42db736b89c8ae10f099565830328a52d3139491f1a/userdata/shm major:0 minor:277 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4eb0726311624a64c819e43cc2184634c654570d28b2b8cc6e66af76958400cd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4eb0726311624a64c819e43cc2184634c654570d28b2b8cc6e66af76958400cd/userdata/shm major:0 minor:289 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76801ec76ac2afaf5feb21cafbd75f61680fc1c0eebc7df933a636a7d304e10f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76801ec76ac2afaf5feb21cafbd75f61680fc1c0eebc7df933a636a7d304e10f/userdata/shm major:0 minor:57 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/913848c05087147f51367be37206221902a27ba69aafc893a14cedeba7088dca/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/913848c05087147f51367be37206221902a27ba69aafc893a14cedeba7088dca/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a82561f778335ae525941a4185a3a162a452bce17457d398a86847e74d2341d4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a82561f778335ae525941a4185a3a162a452bce17457d398a86847e74d2341d4/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ac0cf56c6919934acfa2f07001cc887756181b7993cc82e2447a3925419de284/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ac0cf56c6919934acfa2f07001cc887756181b7993cc82e2447a3925419de284/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b3e9522e2d194f8c8f0fc5bc299b46b99979b77b249bc1e533667cf1eeef5300/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b3e9522e2d194f8c8f0fc5bc299b46b99979b77b249bc1e533667cf1eeef5300/userdata/shm major:0 minor:99 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bc9e2c3aa5020c6a3f5e3d023b180cb0f0cb1ce75ec1ca6ab456d379de6f85aa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bc9e2c3aa5020c6a3f5e3d023b180cb0f0cb1ce75ec1ca6ab456d379de6f85aa/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cf43fb88af810e6a80939382127bf30510671ec63d26d81b09fbbf617c64bbcb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cf43fb88af810e6a80939382127bf30510671ec63d26d81b09fbbf617c64bbcb/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fef881a2dcdf170d7452304e726477c4c5d6d36abcd45f8e4d480a30f383cbcf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fef881a2dcdf170d7452304e726477c4c5d6d36abcd45f8e4d480a30f383cbcf/userdata/shm major:0 minor:283 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0b2bef4e-d720-45a8-a182-94ed8805f845/volumes/kubernetes.io~projected/kube-api-access-2p6pg:{mountpoint:/var/lib/kubelet/pods/0b2bef4e-d720-45a8-a182-94ed8805f845/volumes/kubernetes.io~projected/kube-api-access-2p6pg major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/11c1b4b3-e146-441c-b2e1-7ce37ba61863/volumes/kubernetes.io~projected/kube-api-access-wfpjg:{mountpoint:/var/lib/kubelet/pods/11c1b4b3-e146-441c-b2e1-7ce37ba61863/volumes/kubernetes.io~projected/kube-api-access-wfpjg major:0 minor:155 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/11c1b4b3-e146-441c-b2e1-7ce37ba61863/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/11c1b4b3-e146-441c-b2e1-7ce37ba61863/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:151 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/11c1b4b3-e146-441c-b2e1-7ce37ba61863/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/11c1b4b3-e146-441c-b2e1-7ce37ba61863/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:156 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1b432d50-c888-420f-980f-4e7dd474a44a/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/1b432d50-c888-420f-980f-4e7dd474a44a/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1b432d50-c888-420f-980f-4e7dd474a44a/volumes/kubernetes.io~projected/kube-api-access-bgb99:{mountpoint:/var/lib/kubelet/pods/1b432d50-c888-420f-980f-4e7dd474a44a/volumes/kubernetes.io~projected/kube-api-access-bgb99 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1b432d50-c888-420f-980f-4e7dd474a44a/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/1b432d50-c888-420f-980f-4e7dd474a44a/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:75 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2cbe4ad0-7162-4e44-af92-3a3449226a55/volumes/kubernetes.io~projected/kube-api-access-wm84k:{mountpoint:/var/lib/kubelet/pods/2cbe4ad0-7162-4e44-af92-3a3449226a55/volumes/kubernetes.io~projected/kube-api-access-wm84k major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2cbe4ad0-7162-4e44-af92-3a3449226a55/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/2cbe4ad0-7162-4e44-af92-3a3449226a55/volumes/kubernetes.io~secret/metrics-certs major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39f89f68-342c-4b27-a499-43c10f62a478/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/39f89f68-342c-4b27-a499-43c10f62a478/volumes/kubernetes.io~secret/agent-certs major:0 minor:76 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3a874e0e-2ae1-4716-a5ca-6faf7033f145/volumes/kubernetes.io~projected/kube-api-access-gwrkj:{mountpoint:/var/lib/kubelet/pods/3a874e0e-2ae1-4716-a5ca-6faf7033f145/volumes/kubernetes.io~projected/kube-api-access-gwrkj major:0 minor:81 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/41a3ab36-e89b-4428-ad86-ab439ef4ca6a/volumes/kubernetes.io~projected/kube-api-access-bbqtw:{mountpoint:/var/lib/kubelet/pods/41a3ab36-e89b-4428-ad86-ab439ef4ca6a/volumes/kubernetes.io~projected/kube-api-access-bbqtw major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/41a3ab36-e89b-4428-ad86-ab439ef4ca6a/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/41a3ab36-e89b-4428-ad86-ab439ef4ca6a/volumes/kubernetes.io~secret/metrics-tls major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:271 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/web-config/alertmanager/9 major:0 minor:274 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/web-config/config-reloader/6 major:0 minor:274 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:274 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~empty-dir/config-out major:0 minor:275 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~projected/kube-api-access-brwf6:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~projected/kube-api-access-brwf6 major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~projected/tls-assets major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:271 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/config-volume major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:273 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:268 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:263 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:272 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/web-config major:0 minor:274 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6aa32bba-6dad-4e5d-8959-02f7eeecd506/volumes/kubernetes.io~projected/kube-api-access-c2lbf:{mountpoint:/var/lib/kubelet/pods/6aa32bba-6dad-4e5d-8959-02f7eeecd506/volumes/kubernetes.io~projected/kube-api-access-c2lbf major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6acaaa12-25fa-4251-8354-17f293e2cc26/volumes/kubernetes.io~projected/kube-api-access-bxnm8:{mountpoint:/var/lib/kubelet/pods/6acaaa12-25fa-4251-8354-17f293e2cc26/volumes/kubernetes.io~projected/kube-api-access-bxnm8 major:0 minor:73 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f908d57-06d5-4d74-9044-b3e045c36806/volumes/kubernetes.io~projected/kube-api-access-4nm8q:{mountpoint:/var/lib/kubelet/pods/7f908d57-06d5-4d74-9044-b3e045c36806/volumes/kubernetes.io~projected/kube-api-access-4nm8q major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f908d57-06d5-4d74-9044-b3e045c36806/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/7f908d57-06d5-4d74-9044-b3e045c36806/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/91a1bffe-aa40-4eea-8941-3dc7851929ee/volumes/kubernetes.io~projected/kube-api-access-45mwj:{mountpoint:/var/lib/kubelet/pods/91a1bffe-aa40-4eea-8941-3dc7851929ee/volumes/kubernetes.io~projected/kube-api-access-45mwj major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a23de7dd-cf78-4151-82bb-1b0c770b1189/volumes/kubernetes.io~projected/kube-api-access-wsvc4:{mountpoint:/var/lib/kubelet/pods/a23de7dd-cf78-4151-82bb-1b0c770b1189/volumes/kubernetes.io~projected/kube-api-access-wsvc4 major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a23de7dd-cf78-4151-82bb-1b0c770b1189/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/a23de7dd-cf78-4151-82bb-1b0c770b1189/volumes/kubernetes.io~secret/cert major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a50b6ca7-2a42-4dff-a86e-0e73749997cc/volumes/kubernetes.io~projected/kube-api-access-hd962:{mountpoint:/var/lib/kubelet/pods/a50b6ca7-2a42-4dff-a86e-0e73749997cc/volumes/kubernetes.io~projected/kube-api-access-hd962 major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c7cc9b6d-5ad9-4c08-b523-acee6c40a031/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/c7cc9b6d-5ad9-4c08-b523-acee6c40a031/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:281 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c9648b4c-d83c-4ed0-8844-eab675c6aefe/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/c9648b4c-d83c-4ed0-8844-eab675c6aefe/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c9648b4c-d83c-4ed0-8844-eab675c6aefe/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/c9648b4c-d83c-4ed0-8844-eab675c6aefe/volumes/kubernetes.io~empty-dir/tmp major:0 minor:68 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c9648b4c-d83c-4ed0-8844-eab675c6aefe/volumes/kubernetes.io~projected/kube-api-access-xb2bl:{mountpoint:/var/lib/kubelet/pods/c9648b4c-d83c-4ed0-8844-eab675c6aefe/volumes/kubernetes.io~projected/kube-api-access-xb2bl major:0 minor:74 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/da56277b-ffe8-4870-a562-26fb88dcc0c3/volumes/kubernetes.io~projected/kube-api-access-5vllk:{mountpoint:/var/lib/kubelet/pods/da56277b-ffe8-4870-a562-26fb88dcc0c3/volumes/kubernetes.io~projected/kube-api-access-5vllk major:0 minor:94 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-101:{mountpoint:/var/lib/containers/storage/overlay/b99ba184283357bf049227fe1dee8c05a2af9bb2142fe794cb765d3fc8f40137/merged major:0 minor:101 fsType:overlay blockSize:0} overlay_0-105:{mountpoint:/var/lib/containers/storage/overlay/c849c90e2f645c38cac7219c128ab1e194a11eadb3f924428136f7f968e62e3e/merged major:0 minor:105 fsType:overlay blockSize:0} overlay_0-107:{mountpoint:/var/lib/containers/storage/overlay/1972fa7c7afd8aaad70df3bcb3285a665d95c7c63c15a8f2f8e6cccf2786e3db/merged major:0 minor:107 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/9fd37465606a34473e554041ea314fb31680d115477067d60432f597eef592d2/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/4931f4985264595b0730e5b5cc1187a589323e857829be7edeb47aed3d31907d/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/5aff75d9c1260d7db5bb44145039993efa7dbb67f2115b6372dd3d2ecfd6f7ef/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/a46286307a6b5200c0c378dbcc36b6eb8d4fcf3aea2b1652757a0bf6fc52f42a/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/ec3a94d8561813ec6e3b655c375abf95f6f52976b1d0d02fe5c6d4e669466bdf/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-128:{mountpoint:/var/lib/containers/storage/overlay/33a50440ef2fe524461b7359d73900b325668e4f93b05f162b829f9ea5707188/merged major:0 minor:128 fsType:overlay blockSize:0} overlay_0-130:{mountpoint:/var/lib/containers/storage/overlay/c3978acfa77e7456a297ee3c5d076341005505bf4e9876f10837a51af29d3798/merged major:0 minor:130 fsType:overlay blockSize:0} overlay_0-141:{mountpoint:/var/lib/containers/storage/overlay/fa4df0d8f7f7423f489925267bbb492354962ed52f74210c7128f90e85a0283e/merged major:0 minor:141 fsType:overlay blockSize:0} overlay_0-159:{mountpoint:/var/lib/containers/storage/overlay/49321e645e755c19ad6c2a71d211e8841440cda42554b6d316f9c09d8627e0ed/merged major:0 minor:159 fsType:overlay blockSize:0} overlay_0-161:{mountpoint:/var/lib/containers/storage/overlay/55f63fb351e2707359488e280765db58c349017a1f3c3e7383977feee536d00b/merged major:0 minor:161 fsType:overlay blockSize:0} overlay_0-163:{mountpoint:/var/lib/containers/storage/overlay/20d4d87b5e10b1b29ad2cd3516988d77a3acb2db2d405a1c8c3fd1d0ff24f70b/merged major:0 minor:163 fsType:overlay blockSize:0} overlay_0-168:{mountpoint:/var/lib/containers/storage/overlay/d1600aa7fe2dd6f301f32c57819c79c655c593c0a1ce709035c89b3012606809/merged major:0 minor:168 fsType:overlay blockSize:0} overlay_0-173:{mountpoint:/var/lib/containers/storage/overlay/1b015da28f07c83317f4a336ef193b6c32ab7bcb6b9a8f008766f959ca2bde58/merged major:0 minor:173 fsType:overlay blockSize:0} overlay_0-178:{mountpoint:/var/lib/containers/storage/overlay/95a8cb0660da2e0080e395e694429fff7e725d19d802530ba58fabdd3a57b788/merged major:0 minor:178 fsType:overlay blockSize:0} overlay_0-183:{mountpoint:/var/lib/containers/storage/overlay/bf240042702bb1f57c82bfae99ea3b82518cde369f524892ed1974fc54b8e7c7/merged major:0 minor:183 fsType:overlay blockSize:0} overlay_0-188:{mountpoint:/var/lib/containers/storage/overlay/722c8938894d1c173152c6c462d31034bb0ae604f0fef039b42f3efbe6ca2211/merged major:0 minor:188 fsType:overlay blockSize:0} overlay_0-193:{mountpoint:/var/lib/containers/storage/overlay/fc7a720a75ada4afdf75ae8db36b261a6d9c9ca5ab9268f7fc46b6ea13df03ff/merged major:0 minor:193 fsType:overlay blockSize:0} overlay_0-198:{mountpoint:/var/lib/containers/storage/overlay/b7600dde94c718185d13603bafa1a38c6ff0aad86a02c014a82396dffd82abff/merged major:0 minor:198 fsType:overlay blockSize:0} overlay_0-203:{mountpoint:/var/lib/containers/storage/overlay/e53561e6fda4dc8c1c38469242f4592af7ae865eca51eef8cb2e26c708df9cb4/merged major:0 minor:203 fsType:overlay blockSize:0} overlay_0-208:{mountpoint:/var/lib/containers/storage/overlay/52cedd57b03cda131afedf52e4a204c9d20fc37d40393f450add8f54cf0fc27c/merged major:0 minor:208 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/489233d210c805f47b469c10325682cc76ece87b11242ee2fa97ff48dc01b7f5/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/d90cc3bf7fbbde6924fb514218cb038f6a84135db5eebde8a89ca2299b76791f/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-232:{mountpoint:/var/lib/containers/storage/overlay/ac7aa6bd8bca1743c71338ec8a2029bf5d4d3e0f26564e6104213d96e52c4515/merged major:0 minor:232 fsType:overlay blockSize:0} overlay_0-234:{mountpoint:/var/lib/containers/storage/overlay/117db72eb21acf4e6c3f4a6d08334164c73b2c0ded71929b94705b5f6cd40fdd/merged major:0 minor:234 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/af9a4395745906ec7fb6821696c6905278783c0270ffefa2cdf4fc35803ff212/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-242:{mountpoint:/var/lib/containers/storage/overlay/559591906bced0d14233fdffda82c3ea152c7f856444650bedfccc0b30f38fa7/merged major:0 minor:242 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/8bf22372a2de9577963c96d4e4037193f721fa5e15712a8a4661ae98078cfe5a/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/4c132d30360bdd1e8910ca28d7ef9773703523f19c20fdb87f3f17f697c8a2e3/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/b317e6ee1b471d52ccf7717a5884cbe1b4f810cfe9d8f59bfd2ff9f997168ab0/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-279:{mountpoint:/var/lib/containers/storage/overlay/8f1c97e8eb018485aae8883d388b04d8a86f3d7b834114e39975eb03b404e56f/merged major:0 minor:279 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/a21f4c52491b64918c930268210a69c8787f5a361a5089e8ebf9317faf763b63/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-288:{mountpoint:/var/lib/containers/storage/overlay/ea82e82485aea9d3cb4c047ac70fb46871923313de9f76213b5a341ce8c08de0/merged major:0 minor:288 fsType:overlay blockSize:0} overlay_0-297:{mountpoint:/var/lib/containers/storage/overlay/5f5ff67feba4f4c516d3b2885a99364cc7dd499888aaf9f36b5f0443fe7f161b/merged major:0 minor:297 fsType:overlay blockSize:0} overlay_0-303:{mountpoint:/var/lib/containers/storage/overlay/ea11d1e25b5a3194c3af32acc4bd64bbf0d1f62dc8ddd70faecc62d5c26adda0/merged major:0 minor:303 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/66f4d8bedf60c7e69b8179f1831e497ad1a8b419d8d555fa6f4819cbb9973e42/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/4b5e2347239630a562c2609e163d45b006257ea0402232d03d82569ca67649df/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-315:{mountpoint:/var/lib/containers/storage/overlay/ffeee81960efe18466107b53ef8b062bb69d02e8987a0b20bc332de1aa86038a/merged major:0 minor:315 fsType:overlay blockSize:0} overlay_0-320:{mountpoint:/var/lib/containers/storage/overlay/1934e0b66208b99361a58f564f86133ea30de27f6d220571ccf445be1ba6363f/merged major:0 minor:320 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/a42f8bb3bee94ab9a93f7b189345047b19be86b9a6821a84d4226349bd58325e/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/2e6ea605c234d90d1ac10527f3660aaedf342e5367c256d93b9d8538b3c91f86/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/276c643e4f6570ade82844c581a3cc5d771b71288e391d4e13ff8a4915adcabd/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-335:{mountpoint:/var/lib/containers/storage/overlay/8976b8aa20195702142f9dba0809ac85eccd887c3d9a287ed6567d7ead0d6215/merged major:0 minor:335 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/bfd11193be4d2ee6a0a36d32e5481677bae68b103bf985f3596acffd648c767f/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-45:{mountpoint:/var/lib/containers/storage/overlay/0dd30d2448537c846f51a8e83a62ddd2199e2122895c3d0c453235cb8fe1c507/merged major:0 minor:45 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/30c0af1b03d2da60d089f007b9a47a857be5ca7880c70b11b2bf8fe292849b46/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/3a020da5397ccbaeba1a789eb44f20d3c23d88b444f925b6875f9e127a7d43ec/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-55:{mountpoint:/var/lib/containers/storage/overlay/09532c9bdacbaba21a2eef3d5120914bbe7e9b0a0dc567a2efd0c4c41259c37f/merged major:0 minor:55 fsType:overlay blockSize:0} overlay_0-61:{mountpoint:/var/lib/containers/storage/overlay/7d8ceeed5af9c69f2d45dc8a2996d85103489853b8cc54e8083a8705cf18c7eb/merged major:0 minor:61 fsType:overlay blockSize:0} overlay_0-71:{mountpoint:/var/lib/containers/storage/overlay/880699cb39ed4c65f3fa0edb0bbcbfcefd03e8f4681f188913490f4bc3d01f24/merged major:0 minor:71 fsType:overlay blockSize:0} overlay_0-79:{mountpoint:/var/lib/containers/storage/overlay/455588098b856e247a1361c9f3ebba8831d37feb39283a42a15a68571cb7753c/merged major:0 minor:79 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/4de520e2fc02c48bebe84eaf95e6ade7ee47207c275d2d30f503cf88af405059/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/c19c1b94dd58f946d04ab1b9bcebaf8f6d802e3bf9875128c21540b9e3fff16f/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/2f456d09396daa72e5e2bcde35db44ff0de34e07b2bc8e31da6f1d85d6fe584c/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-97:{mountpoint:/var/lib/containers/storage/overlay/e7133a0a45a9e8c598b183ffb9da233b014129ee3df735a6f006bc233606b159/merged major:0 minor:97 fsType:overlay blockSize:0}] Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.565639 5219 manager.go:217] Machine: {Timestamp:2026-11-04 02:07:34.564855497 +0000 UTC m=+0.053364190 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199632 MemoryCapacity:32812007424 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec273020d9c26ce883d9303a01c0de4c SystemUUID:ec273020-d9c2-6ce8-83d9-303a01c0de4c BootID:4b5d307f-0ac9-43f4-abd2-d75d289ab62a Filesystems:[{Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:271 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/212ed90324864507066d142a48bdcecae5a06c03713bd53244554ca26f13a615/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-193 DeviceMajor:0 DeviceMinor:193 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:275 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/11c1b4b3-e146-441c-b2e1-7ce37ba61863/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:156 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:268 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:274 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-128 DeviceMajor:0 DeviceMinor:128 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c9648b4c-d83c-4ed0-8844-eab675c6aefe/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:67 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:270 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1aa394d33066277b5090cb98550f2ecf1893decab986a8ed73bfd797e6eb8808/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/91a1bffe-aa40-4eea-8941-3dc7851929ee/volumes/kubernetes.io~projected/kube-api-access-45mwj DeviceMajor:0 DeviceMinor:66 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-173 DeviceMajor:0 DeviceMinor:173 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:263 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:272 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-320 DeviceMajor:0 DeviceMinor:320 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-97 DeviceMajor:0 DeviceMinor:97 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/02019e9df5a86d8332fd6ba93caa4e1eea89010481b8e639bdc96a98bb218c24/userdata/shm DeviceMajor:0 DeviceMinor:103 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-45 DeviceMajor:0 DeviceMinor:45 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-297 DeviceMajor:0 DeviceMinor:297 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c9648b4c-d83c-4ed0-8844-eab675c6aefe/volumes/kubernetes.io~projected/kube-api-access-xb2bl DeviceMajor:0 DeviceMinor:74 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/0b2bef4e-d720-45a8-a182-94ed8805f845/volumes/kubernetes.io~projected/kube-api-access-2p6pg DeviceMajor:0 DeviceMinor:65 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-141 DeviceMajor:0 DeviceMinor:141 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cf43fb88af810e6a80939382127bf30510671ec63d26d81b09fbbf617c64bbcb/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:269 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~projected/kube-api-access-brwf6 DeviceMajor:0 DeviceMinor:276 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4b9a9dfcaffb06327692c42db736b89c8ae10f099565830328a52d3139491f1a/userdata/shm DeviceMajor:0 DeviceMinor:277 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-55 DeviceMajor:0 DeviceMinor:55 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-107 DeviceMajor:0 DeviceMinor:107 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-303 DeviceMajor:0 DeviceMinor:303 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2cbe4ad0-7162-4e44-af92-3a3449226a55/volumes/kubernetes.io~projected/kube-api-access-wm84k DeviceMajor:0 DeviceMinor:63 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/1b432d50-c888-420f-980f-4e7dd474a44a/volumes/kubernetes.io~projected/kube-api-access-bgb99 DeviceMajor:0 DeviceMinor:64 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f2a9234127298e19f33426c0282ecec0be0a2381d02f85fd3584a968689025d/userdata/shm DeviceMajor:0 DeviceMinor:157 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/41a3ab36-e89b-4428-ad86-ab439ef4ca6a/volumes/kubernetes.io~projected/kube-api-access-bbqtw DeviceMajor:0 DeviceMinor:220 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406003712 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-159 DeviceMajor:0 DeviceMinor:159 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-242 DeviceMajor:0 DeviceMinor:242 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2cbe4ad0-7162-4e44-af92-3a3449226a55/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:282 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/49cb499320957b748a36b25248cfd3524ad4e557f5ac8c7f3dc438bb98d0f68c/userdata/shm DeviceMajor:0 DeviceMinor:69 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/da56277b-ffe8-4870-a562-26fb88dcc0c3/volumes/kubernetes.io~projected/kube-api-access-5vllk DeviceMajor:0 DeviceMinor:94 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-315 DeviceMajor:0 DeviceMinor:315 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6aa32bba-6dad-4e5d-8959-02f7eeecd506/volumes/kubernetes.io~projected/kube-api-access-c2lbf DeviceMajor:0 DeviceMinor:62 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-101 DeviceMajor:0 DeviceMinor:101 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-208 DeviceMajor:0 DeviceMinor:208 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/41a3ab36-e89b-4428-ad86-ab439ef4ca6a/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:217 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/7f908d57-06d5-4d74-9044-b3e045c36806/volumes/kubernetes.io~projected/kube-api-access-4nm8q DeviceMajor:0 DeviceMinor:221 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/11c1b4b3-e146-441c-b2e1-7ce37ba61863/volumes/kubernetes.io~projected/kube-api-access-wfpjg DeviceMajor:0 DeviceMinor:155 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-188 DeviceMajor:0 DeviceMinor:188 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:274 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3a874e0e-2ae1-4716-a5ca-6faf7033f145/volumes/kubernetes.io~projected/kube-api-access-gwrkj DeviceMajor:0 DeviceMinor:81 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/76801ec76ac2afaf5feb21cafbd75f61680fc1c0eebc7df933a636a7d304e10f/userdata/shm DeviceMajor:0 DeviceMinor:57 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-130 DeviceMajor:0 DeviceMinor:130 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-163 DeviceMajor:0 DeviceMinor:163 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7f908d57-06d5-4d74-9044-b3e045c36806/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:218 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a82561f778335ae525941a4185a3a162a452bce17457d398a86847e74d2341d4/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/17b4b8279df44dce4038f0546f718199b8bfbbefeff3a84e1741db44a222d8a7/userdata/shm DeviceMajor:0 DeviceMinor:222 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:274 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/913848c05087147f51367be37206221902a27ba69aafc893a14cedeba7088dca/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/39f89f68-342c-4b27-a499-43c10f62a478/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:76 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-183 DeviceMajor:0 DeviceMinor:183 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a23de7dd-cf78-4151-82bb-1b0c770b1189/volumes/kubernetes.io~projected/kube-api-access-wsvc4 DeviceMajor:0 DeviceMinor:219 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3b8a95d9acd48d7bee86458fbf01c69dc74ddd09a6b1601b4a4b425e5578511e/userdata/shm DeviceMajor:0 DeviceMinor:225 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:274 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-203 DeviceMajor:0 DeviceMinor:203 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ac0cf56c6919934acfa2f07001cc887756181b7993cc82e2447a3925419de284/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-79 DeviceMajor:0 DeviceMinor:79 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-168 DeviceMajor:0 DeviceMinor:168 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-178 DeviceMajor:0 DeviceMinor:178 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1b432d50-c888-420f-980f-4e7dd474a44a/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/c7cc9b6d-5ad9-4c08-b523-acee6c40a031/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:281 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fef881a2dcdf170d7452304e726477c4c5d6d36abcd45f8e4d480a30f383cbcf/userdata/shm DeviceMajor:0 DeviceMinor:283 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-335 DeviceMajor:0 DeviceMinor:335 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:273 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/1b432d50-c888-420f-980f-4e7dd474a44a/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:75 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/11c1b4b3-e146-441c-b2e1-7ce37ba61863/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:151 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-198 DeviceMajor:0 DeviceMinor:198 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a50b6ca7-2a42-4dff-a86e-0e73749997cc/volumes/kubernetes.io~projected/kube-api-access-hd962 DeviceMajor:0 DeviceMinor:285 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/61936444-21d0-45a0-b2b2-57cdcd514f3a/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:271 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6acaaa12-25fa-4251-8354-17f293e2cc26/volumes/kubernetes.io~projected/kube-api-access-bxnm8 DeviceMajor:0 DeviceMinor:73 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bc9e2c3aa5020c6a3f5e3d023b180cb0f0cb1ce75ec1ca6ab456d379de6f85aa/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-71 DeviceMajor:0 DeviceMinor:71 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-234 DeviceMajor:0 DeviceMinor:234 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406003712 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-105 DeviceMajor:0 DeviceMinor:105 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4eb0726311624a64c819e43cc2184634c654570d28b2b8cc6e66af76958400cd/userdata/shm DeviceMajor:0 DeviceMinor:289 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-61 DeviceMajor:0 DeviceMinor:61 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b3e9522e2d194f8c8f0fc5bc299b46b99979b77b249bc1e533667cf1eeef5300/userdata/shm DeviceMajor:0 DeviceMinor:99 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/a23de7dd-cf78-4151-82bb-1b0c770b1189/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:213 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-232 DeviceMajor:0 DeviceMinor:232 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c9648b4c-d83c-4ed0-8844-eab675c6aefe/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:68 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3e4f3dd3f6b470ac1ccd9b9ddda16b7e3fcfc95e4d8e35774c62b008f48f1479/userdata/shm DeviceMajor:0 DeviceMinor:95 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-161 DeviceMajor:0 DeviceMinor:161 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-279 DeviceMajor:0 DeviceMinor:279 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-288 DeviceMajor:0 DeviceMinor:288 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:17b4b8279df44dc MacAddress:92:72:45:3a:71:3f Speed:10000 Mtu:8901} {Name:1aa394d33066277 MacAddress:ce:06:6e:56:78:6e Speed:10000 Mtu:8901} {Name:3b8a95d9acd48d7 MacAddress:fe:60:50:73:40:85 Speed:10000 Mtu:8901} {Name:4b9a9dfcaffb063 MacAddress:be:81:8e:9d:5a:2f Speed:10000 Mtu:8901} {Name:4eb0726311624a6 MacAddress:82:45:0b:62:1b:26 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:46:57:13:96:23 Speed:0 Mtu:9001} {Name:br-int MacAddress:66:d0:84:21:c3:d9 Speed:0 Mtu:8901} {Name:cf43fb88af810e6 MacAddress:ca:12:e4:e4:8c:69 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:46:57:13:96:23 Speed:0 Mtu:9001} {Name:fef881a2dcdf170 MacAddress:12:72:a7:ea:e5:b6 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:6a:3d:ea:77:89:89 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ae:b5:d4:04:47:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812007424 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.566334 5219 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.566401 5219 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.566659 5219 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.566678 5219 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-225.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.566785 5219 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.566791 5219 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.566800 5219 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.566817 5219 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.566876 5219 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.567018 5219 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.567104 5219 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.567135 5219 kubelet.go:493] "Attempting to sync node with API server" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.567147 5219 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.567156 5219 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.567163 5219 kubelet.go:405] "Adding apiserver pod source" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.567170 5219 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.567727 5219 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.567735 5219 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 02:07:34.569152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.568219 5219 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 02:07:34.571249 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571236 5219 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 02:07:34.571298 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571250 5219 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 02:07:34.571374 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571363 5219 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 04 02:07:34.571537 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571526 5219 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 02:07:34.571570 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571555 5219 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 02:07:34.571652 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571643 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 02:07:34.571695 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571656 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 02:07:34.571695 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571663 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 02:07:34.571695 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571668 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 02:07:34.571695 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571683 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 02:07:34.571695 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571691 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 02:07:34.571695 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571697 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 02:07:34.571909 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571702 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 02:07:34.571909 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571709 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 02:07:34.571909 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571714 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 02:07:34.571909 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571726 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 02:07:34.571909 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571735 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 02:07:34.571909 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571758 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 02:07:34.571909 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.571763 5219 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 02:07:34.574866 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.574854 5219 server.go:1263] "Started kubelet" Nov 04 02:07:34.575449 ip-10-0-135-225 systemd[1]: Started Kubernetes Kubelet. Nov 04 02:07:34.575847 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.575435 5219 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 02:07:34.576305 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.574972 5219 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 02:07:34.576305 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.576267 5219 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 02:07:34.576746 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.576719 5219 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 02:07:34.578975 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.578874 5219 server.go:317] "Adding debug handlers to kubelet server" Nov 04 02:07:34.579635 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.579618 5219 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 02:07:34.579851 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.579838 5219 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 02:07:34.579851 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.579852 5219 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 02:07:34.580016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.579935 5219 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 02:07:34.580016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.579961 5219 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 02:07:34.580183 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:34.580118 5219 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:07:34.580646 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.580619 5219 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:01:22 +0000 UTC" deadline="2028-04-01 02:36:29.089728382 +0000 UTC" Nov 04 02:07:34.580726 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.580648 5219 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12336h28m54.509083937s" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.582140 5219 factory.go:55] Registering systemd factory Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.582162 5219 factory.go:223] Registration of the systemd container factory successfully Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.582501 5219 factory.go:153] Registering CRI-O factory Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.582515 5219 factory.go:223] Registration of the crio container factory successfully Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.582564 5219 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.582584 5219 factory.go:103] Registering Raw factory Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.582597 5219 manager.go:1199] Started watching for new ooms in manager Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583049 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b432d50-c888-420f-980f-4e7dd474a44a" volumeName="kubernetes.io/projected/1b432d50-c888-420f-980f-4e7dd474a44a-kube-api-access-bgb99" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583083 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="91a1bffe-aa40-4eea-8941-3dc7851929ee" volumeName="kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-binary-copy" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583102 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b432d50-c888-420f-980f-4e7dd474a44a" volumeName="kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-script-lib" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583115 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2cbe4ad0-7162-4e44-af92-3a3449226a55" volumeName="kubernetes.io/projected/2cbe4ad0-7162-4e44-af92-3a3449226a55-kube-api-access-wm84k" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583125 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583138 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="91a1bffe-aa40-4eea-8941-3dc7851929ee" volumeName="kubernetes.io/projected/91a1bffe-aa40-4eea-8941-3dc7851929ee-kube-api-access-45mwj" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583151 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583164 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9648b4c-d83c-4ed0-8844-eab675c6aefe" volumeName="kubernetes.io/projected/c9648b4c-d83c-4ed0-8844-eab675c6aefe-kube-api-access-xb2bl" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583179 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b2bef4e-d720-45a8-a182-94ed8805f845" volumeName="kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-daemon-config" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583192 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b432d50-c888-420f-980f-4e7dd474a44a" volumeName="kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-env-overrides" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583205 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39f89f68-342c-4b27-a499-43c10f62a478" volumeName="kubernetes.io/configmap/39f89f68-342c-4b27-a499-43c10f62a478-konnectivity-ca" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583218 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-main-db" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583230 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-out" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583242 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f908d57-06d5-4d74-9044-b3e045c36806" volumeName="kubernetes.io/configmap/7f908d57-06d5-4d74-9044-b3e045c36806-kube-rbac-proxy-cm" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583257 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f908d57-06d5-4d74-9044-b3e045c36806" volumeName="kubernetes.io/projected/7f908d57-06d5-4d74-9044-b3e045c36806-kube-api-access-4nm8q" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583271 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a50b6ca7-2a42-4dff-a86e-0e73749997cc" volumeName="kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583303 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a874e0e-2ae1-4716-a5ca-6faf7033f145" volumeName="kubernetes.io/projected/3a874e0e-2ae1-4716-a5ca-6faf7033f145-kube-api-access-gwrkj" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583316 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-kube-api-access-brwf6" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583328 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="91a1bffe-aa40-4eea-8941-3dc7851929ee" volumeName="kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583340 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9648b4c-d83c-4ed0-8844-eab675c6aefe" volumeName="kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-tuned" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583352 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="da56277b-ffe8-4870-a562-26fb88dcc0c3" volumeName="kubernetes.io/projected/da56277b-ffe8-4870-a562-26fb88dcc0c3-kube-api-access-5vllk" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583365 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11c1b4b3-e146-441c-b2e1-7ce37ba61863" volumeName="kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-metrics-client-ca" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583377 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2cbe4ad0-7162-4e44-af92-3a3449226a55" volumeName="kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583388 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6aa32bba-6dad-4e5d-8959-02f7eeecd506" volumeName="kubernetes.io/projected/6aa32bba-6dad-4e5d-8959-02f7eeecd506-kube-api-access-c2lbf" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583421 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f908d57-06d5-4d74-9044-b3e045c36806" volumeName="kubernetes.io/empty-dir/7f908d57-06d5-4d74-9044-b3e045c36806-data-volume" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583433 5219 manager.go:319] Starting recovery of all containers Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.583436 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f908d57-06d5-4d74-9044-b3e045c36806" volumeName="kubernetes.io/secret/7f908d57-06d5-4d74-9044-b3e045c36806-insights-runtime-extractor-tls" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585362 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11c1b4b3-e146-441c-b2e1-7ce37ba61863" volumeName="kubernetes.io/projected/11c1b4b3-e146-441c-b2e1-7ce37ba61863-kube-api-access-wfpjg" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585389 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11c1b4b3-e146-441c-b2e1-7ce37ba61863" volumeName="kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585410 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="41a3ab36-e89b-4428-ad86-ab439ef4ca6a" volumeName="kubernetes.io/secret/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-metrics-tls" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585421 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-metrics-client-ca" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585434 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c7cc9b6d-5ad9-4c08-b523-acee6c40a031" volumeName="kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585445 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b2bef4e-d720-45a8-a182-94ed8805f845" volumeName="kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-cni-binary-copy" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585457 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11c1b4b3-e146-441c-b2e1-7ce37ba61863" volumeName="kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-tls" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585468 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="41a3ab36-e89b-4428-ad86-ab439ef4ca6a" volumeName="kubernetes.io/configmap/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-config-volume" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585480 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="41a3ab36-e89b-4428-ad86-ab439ef4ca6a" volumeName="kubernetes.io/empty-dir/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-tmp-dir" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585491 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="41a3ab36-e89b-4428-ad86-ab439ef4ca6a" volumeName="kubernetes.io/projected/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-kube-api-access-bbqtw" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585503 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585514 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6aa32bba-6dad-4e5d-8959-02f7eeecd506" volumeName="kubernetes.io/configmap/6aa32bba-6dad-4e5d-8959-02f7eeecd506-iptables-alerter-script" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585528 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39f89f68-342c-4b27-a499-43c10f62a478" volumeName="kubernetes.io/secret/39f89f68-342c-4b27-a499-43c10f62a478-agent-certs" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585538 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585550 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a23de7dd-cf78-4151-82bb-1b0c770b1189" volumeName="kubernetes.io/secret/a23de7dd-cf78-4151-82bb-1b0c770b1189-cert" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585579 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9648b4c-d83c-4ed0-8844-eab675c6aefe" volumeName="kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-tmp" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585591 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-volume" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585602 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-web-config" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585614 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b432d50-c888-420f-980f-4e7dd474a44a" volumeName="kubernetes.io/secret/1b432d50-c888-420f-980f-4e7dd474a44a-ovn-node-metrics-cert" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585625 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-tls-assets" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585636 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a23de7dd-cf78-4151-82bb-1b0c770b1189" volumeName="kubernetes.io/projected/a23de7dd-cf78-4151-82bb-1b0c770b1189-kube-api-access-wsvc4" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585647 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11c1b4b3-e146-441c-b2e1-7ce37ba61863" volumeName="kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-accelerators-collector-config" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585659 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a874e0e-2ae1-4716-a5ca-6faf7033f145" volumeName="kubernetes.io/configmap/3a874e0e-2ae1-4716-a5ca-6faf7033f145-serviceca" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585670 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-cluster-tls-config" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585682 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6acaaa12-25fa-4251-8354-17f293e2cc26" volumeName="kubernetes.io/empty-dir/6acaaa12-25fa-4251-8354-17f293e2cc26-tmp-dir" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585694 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="91a1bffe-aa40-4eea-8941-3dc7851929ee" volumeName="kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-sysctl-allowlist" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585709 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b2bef4e-d720-45a8-a182-94ed8805f845" volumeName="kubernetes.io/projected/0b2bef4e-d720-45a8-a182-94ed8805f845-kube-api-access-2p6pg" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585720 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61936444-21d0-45a0-b2b2-57cdcd514f3a" volumeName="kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-main-tls" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585732 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6acaaa12-25fa-4251-8354-17f293e2cc26" volumeName="kubernetes.io/projected/6acaaa12-25fa-4251-8354-17f293e2cc26-kube-api-access-bxnm8" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585743 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b432d50-c888-420f-980f-4e7dd474a44a" volumeName="kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-config" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585765 5219 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11c1b4b3-e146-441c-b2e1-7ce37ba61863" volumeName="kubernetes.io/empty-dir/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-textfile" seLinuxMountContext="" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585777 5219 reconstruct.go:97] "Volume reconstruction finished" Nov 04 02:07:34.586096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.585785 5219 reconciler.go:29] "Reconciler: start to sync state" Nov 04 02:07:34.600128 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.600104 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:07:34.600864 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.600842 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:07:34.606434 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.606395 5219 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 02:07:34.607813 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.607795 5219 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 02:07:34.607898 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.607818 5219 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 02:07:34.607898 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.607834 5219 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 02:07:34.607898 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:34.607868 5219 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 04 02:07:34.618908 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.618864 5219 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="c6042ff34b7d39b6bc97e965ee3f9b110b921ceb51b9c049852d8a42d8de0c43" exitCode=0 Nov 04 02:07:34.618908 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.618905 5219 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="2189beba771387783c3afd21df8791f1c093113efa327fbd4b9e5d95a8426ecc" exitCode=0 Nov 04 02:07:34.619058 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.618914 5219 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="df23bab4f6889abc23967ff753974dd43a6149b36b189e94aa040276fa92ebe2" exitCode=0 Nov 04 02:07:34.619058 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.618919 5219 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="948b8a37c88925126cdb9ecec24f9e68aa5eaf21d422bb72421c1a95fbe02d67" exitCode=0 Nov 04 02:07:34.619058 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.618924 5219 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="973dc385f560a387b3be6d7c5a54f886244730168c91b3a1fa671ed6e032480b" exitCode=0 Nov 04 02:07:34.619058 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.618929 5219 generic.go:356] "Generic (PLEG): container finished" podID="91a1bffe-aa40-4eea-8941-3dc7851929ee" containerID="d2cc2b2464d7b871d6c47c8e04950d6f810a3127fd85960f8897ea9284c33716" exitCode=0 Nov 04 02:07:34.622458 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.622436 5219 generic.go:356] "Generic (PLEG): container finished" podID="5147ba6182c6560312729cb5a30df3cf" containerID="e57f5c64666ef85964d34a21b42dc8f0df27930b37c5ec2b9c0bc4018af4aacb" exitCode=0 Nov 04 02:07:34.631992 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.631977 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:07:34.632355 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.632332 5219 generic.go:356] "Generic (PLEG): container finished" podID="1b432d50-c888-420f-980f-4e7dd474a44a" containerID="952552fef87ebfd2bc61ca5b60bb5ee93b6cec74d8ccc8c32f3bbdb51e9b629e" exitCode=1 Nov 04 02:07:34.642548 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.642530 5219 generic.go:356] "Generic (PLEG): container finished" podID="11c1b4b3-e146-441c-b2e1-7ce37ba61863" containerID="dd6f13120f942ba9db74815e1b974cad2df34d4621353763e0f60917a2930aac" exitCode=0 Nov 04 02:07:34.651506 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.651485 5219 generic.go:356] "Generic (PLEG): container finished" podID="61936444-21d0-45a0-b2b2-57cdcd514f3a" containerID="c47b28b998a980b8081e4ae1afcceaa70b1cb7f3dfeeb91f62ab8809ae256bce" exitCode=0 Nov 04 02:07:34.665110 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.665096 5219 manager.go:324] Recovery completed Nov 04 02:07:34.680241 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:34.680218 5219 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:07:34.680320 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.680268 5219 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:07:34.681834 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.681818 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:07:34.681902 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.681852 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:07:34.681902 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.681869 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:07:34.683846 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.683828 5219 cpu_manager.go:226] "Starting" policy="none" Nov 04 02:07:34.683846 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.683841 5219 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:07:34.683846 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.683844 5219 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 02:07:34.683971 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.683863 5219 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 02:07:34.684018 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.684007 5219 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 04 02:07:34.684049 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.684019 5219 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 04 02:07:34.684049 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.684043 5219 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 04 02:07:34.684049 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.684048 5219 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 04 02:07:34.684120 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.684054 5219 policy_none.go:50] "Start" Nov 04 02:07:34.684120 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.684062 5219 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 02:07:34.684120 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.684071 5219 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 02:07:34.684702 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.684688 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:07:34.684772 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.684718 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:07:34.684772 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.684732 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:07:34.685315 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.685302 5219 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 04 02:07:34.685368 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.685316 5219 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 04 02:07:34.685368 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.685323 5219 policy_none.go:44] "Start" Nov 04 02:07:34.690853 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.690826 5219 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 02:07:34.693463 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.693439 5219 manager.go:341] "Starting Device Plugin manager" Nov 04 02:07:34.693546 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:34.693465 5219 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 02:07:34.693546 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.693473 5219 server.go:87] "Starting device plugin registration server" Nov 04 02:07:34.693705 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.693693 5219 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 02:07:34.693749 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.693707 5219 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 02:07:34.693793 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.693785 5219 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 02:07:34.693952 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.693917 5219 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 02:07:34.694019 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.693959 5219 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 02:07:34.694019 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.693965 5219 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 02:07:34.694109 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.694012 5219 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T02:07:34.693950027Z","UUID":"1add33c1-9ac8-4fbc-81a8-c35b735f1e3f","Handler":null,"Name":"","Endpoint":""} Nov 04 02:07:34.695565 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:34.695459 5219 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 02:07:34.695565 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:34.695495 5219 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" Nov 04 02:07:34.696663 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.696645 5219 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 02:07:34.696746 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.696678 5219 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 02:07:34.708827 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.708308 5219 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal"] Nov 04 02:07:34.708914 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.708901 5219 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:07:34.709701 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.709687 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:07:34.709781 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.709712 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:07:34.709781 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.709722 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:07:34.709945 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.709935 5219 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:07:34.710090 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.710061 5219 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:07:34.710700 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.710686 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:07:34.710700 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.710694 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:07:34.710804 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.710710 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:07:34.710804 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.710715 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:07:34.710804 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.710719 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:07:34.710804 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.710726 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:07:34.710913 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:34.710839 5219 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.710951 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.710927 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"5147ba6182c6560312729cb5a30df3cf","Type":"ContainerStarted","Data":"36ee08d8b76d7d15adc005e65b1cc6ee0900d499ad19aa1aa6676ba35543f725"} Nov 04 02:07:34.710980 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.710961 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"5147ba6182c6560312729cb5a30df3cf","Type":"ContainerDied","Data":"e57f5c64666ef85964d34a21b42dc8f0df27930b37c5ec2b9c0bc4018af4aacb"} Nov 04 02:07:34.710980 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.710976 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"5147ba6182c6560312729cb5a30df3cf","Type":"ContainerStarted","Data":"bc9e2c3aa5020c6a3f5e3d023b180cb0f0cb1ce75ec1ca6ab456d379de6f85aa"} Nov 04 02:07:34.711034 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.711015 5219 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:07:34.711060 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.711036 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"d1c08604dc1c779dd155121103c79330","Type":"ContainerStarted","Data":"95b9f93a8ae6c98a8559e88eee4248b06e7e4676eaf5ea8ffaa853935fb1d5e0"} Nov 04 02:07:34.711060 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.711048 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" event={"ID":"d1c08604dc1c779dd155121103c79330","Type":"ContainerStarted","Data":"913848c05087147f51367be37206221902a27ba69aafc893a14cedeba7088dca"} Nov 04 02:07:34.711708 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.711693 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:07:34.711789 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.711718 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:07:34.711789 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.711728 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:07:34.711858 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:34.711832 5219 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-225.us-west-1.compute.internal\" not found" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.777099 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.777051 5219 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 02:07:34.777896 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.777885 5219 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 02:07:34.778676 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.778663 5219 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 02:07:34.781222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.781209 5219 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.794320 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.794309 5219 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 02:07:34.795077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.795057 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 02:07:34.795165 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.795084 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 02:07:34.795165 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.795099 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 02:07:34.795165 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.795114 5219 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.876341 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.876325 5219 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 02:07:34.877041 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.877025 5219 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 02:07:34.877113 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.877089 5219 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 04 02:07:34.877150 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:34.877104 5219 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.877150 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.877123 5219 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.928799 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.928784 5219 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.928875 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.928827 5219 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.929215 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.929197 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeNotReady" Nov 04 02:07:34.929258 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.929233 5219 setters.go:546] "Node became not ready" node="ip-10-0-135-225.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-11-04T02:07:34Z","lastTransitionTime":"2026-11-04T02:07:34Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"} Nov 04 02:07:34.938064 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.938043 5219 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 02:07:34.938163 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:34.938148 5219 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.977369 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.977353 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.977420 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.977374 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c08604dc1c779dd155121103c79330-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"d1c08604dc1c779dd155121103c79330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.977420 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.977391 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:34.989189 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:34.989170 5219 nodeinfomanager.go:471] existing CSINode "ip-10-0-135-225.us-west-1.compute.internal" is owned by different node (oldNodeID="9574c73a-2a06-4ce2-b9ca-963317a4c3fc", newNodeID=""), cleaning up... Nov 04 02:07:35.077685 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.077636 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:35.077685 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.077664 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:35.077685 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.077674 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:35.077807 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.077699 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c08604dc1c779dd155121103c79330-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"d1c08604dc1c779dd155121103c79330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:35.077807 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.077720 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5147ba6182c6560312729cb5a30df3cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"5147ba6182c6560312729cb5a30df3cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:35.077807 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.077735 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c08604dc1c779dd155121103c79330-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal\" (UID: \"d1c08604dc1c779dd155121103c79330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:35.567867 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.567847 5219 apiserver.go:52] "Watching apiserver" Nov 04 02:07:35.654616 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.654600 5219 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:35.654763 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.654750 5219 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:35.670360 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.670344 5219 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 02:07:35.670854 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.670837 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-59cvz","openshift-cluster-node-tuning-operator/tuned-5zgbq","openshift-image-registry/node-ca-pd9w7","openshift-network-diagnostics/network-check-target-wrp97","openshift-multus/multus-b4zjs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w","openshift-monitoring/alertmanager-main-0","openshift-multus/network-metrics-daemon-rm28p","kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal","openshift-dns/node-resolver-f9dj5","openshift-insights/insights-runtime-extractor-8f6tb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal","openshift-ovn-kubernetes/ovnkube-node-kbkqw","openshift-monitoring/node-exporter-kv495","openshift-ingress-canary/ingress-canary-jlmzj","openshift-multus/multus-additional-cni-plugins-jc6hh","kube-system/global-pull-secret-syncer-ftvnd","openshift-dns/dns-default-2zhl2","kube-system/konnectivity-agent-g52g2"] Nov 04 02:07:35.681573 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681553 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f908d57-06d5-4d74-9044-b3e045c36806-crio-socket\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.681680 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681594 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f908d57-06d5-4d74-9044-b3e045c36806-data-volume\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.681734 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681691 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f908d57-06d5-4d74-9044-b3e045c36806-data-volume\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.681734 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681715 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-netd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.681829 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681768 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b432d50-c888-420f-980f-4e7dd474a44a-ovn-node-metrics-cert\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.681829 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681805 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-sys\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.681924 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681828 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-root\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.681924 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681884 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-textfile\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.681924 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681914 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.682059 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681950 5219 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 02:07:35.682059 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.681987 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.682059 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682012 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39f89f68-342c-4b27-a499-43c10f62a478-agent-certs\") pod \"konnectivity-agent-g52g2\" (UID: \"39f89f68-342c-4b27-a499-43c10f62a478\") " pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:07:35.682059 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682035 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-textfile\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.682212 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682047 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-accelerators-collector-config\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.682212 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682095 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-web-config\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.682212 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682113 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-bin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.682212 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682127 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-etc-kubernetes\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.682212 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682140 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-dbus\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:35.682212 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682156 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbqtw\" (UniqueName: \"kubernetes.io/projected/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-kube-api-access-bbqtw\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:35.682212 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682170 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-socket-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.682425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682310 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.682425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682327 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-kubelet-config\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:35.682425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682349 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-tls\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.682425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682364 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.682425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682378 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.682642 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682434 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.682642 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682471 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-config-volume\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:35.682642 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682485 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:35.682642 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682505 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.682642 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682520 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-lib-modules\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.682642 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682532 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-host\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.682642 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682547 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-tuned\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.682642 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682585 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-device-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.682642 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682641 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.682943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682654 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-tuned\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.682943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682676 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39f89f68-342c-4b27-a499-43c10f62a478-konnectivity-ca\") pod \"konnectivity-agent-g52g2\" (UID: \"39f89f68-342c-4b27-a499-43c10f62a478\") " pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:07:35.682943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682700 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-conf-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.682943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682731 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p6pg\" (UniqueName: \"kubernetes.io/projected/0b2bef4e-d720-45a8-a182-94ed8805f845-kube-api-access-2p6pg\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.682943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682757 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.682943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682771 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6acaaa12-25fa-4251-8354-17f293e2cc26-hosts-file\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:07:35.682943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682794 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-bin\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.682943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682810 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.682943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682849 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-run\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.682943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682938 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2lbf\" (UniqueName: \"kubernetes.io/projected/6aa32bba-6dad-4e5d-8959-02f7eeecd506-kube-api-access-c2lbf\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.682967 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acaaa12-25fa-4251-8354-17f293e2cc26-tmp-dir\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683002 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-system-cni-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683034 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-metrics-tls\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683061 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-node-log\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683072 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acaaa12-25fa-4251-8354-17f293e2cc26-tmp-dir\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683114 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683142 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-system-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683176 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-socket-dir-parent\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683210 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-netns\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683247 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-hostroot\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683272 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nm8q\" (UniqueName: \"kubernetes.io/projected/7f908d57-06d5-4d74-9044-b3e045c36806-kube-api-access-4nm8q\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.683370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683316 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-sys-fs\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683400 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683421 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-var-lib-kubelet\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683476 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-systemd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683497 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-etc-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683549 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-wtmp\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683589 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683613 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-cnibin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683635 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-multus-certs\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683656 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-netns\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683679 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-metrics-client-ca\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683699 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-multus\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683779 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-kubelet\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683810 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysconfig\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.683832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683831 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-sys\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683856 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-tmp-dir\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683919 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-registration-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683938 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-var-lib-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683939 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-tmp-dir\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.683985 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-log-socket\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684007 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-script-lib\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684044 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684085 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfpjg\" (UniqueName: \"kubernetes.io/projected/11c1b4b3-e146-441c-b2e1-7ce37ba61863-kube-api-access-wfpjg\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684112 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684160 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxnm8\" (UniqueName: \"kubernetes.io/projected/6acaaa12-25fa-4251-8354-17f293e2cc26-kube-api-access-bxnm8\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684174 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-kubelet\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684188 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-env-overrides\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684202 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsvc4\" (UniqueName: \"kubernetes.io/projected/a23de7dd-cf78-4151-82bb-1b0c770b1189-kube-api-access-wsvc4\") pod \"ingress-canary-jlmzj\" (UID: \"a23de7dd-cf78-4151-82bb-1b0c770b1189\") " pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684227 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684244 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684266 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-kubernetes\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684356 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684389 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aa32bba-6dad-4e5d-8959-02f7eeecd506-iptables-alerter-script\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684415 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vllk\" (UniqueName: \"kubernetes.io/projected/da56277b-ffe8-4870-a562-26fb88dcc0c3-kube-api-access-5vllk\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.684451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684445 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-ovn\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684476 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684513 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-config\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684554 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-systemd\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684584 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-tmp\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684621 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb2bl\" (UniqueName: \"kubernetes.io/projected/c9648b4c-d83c-4ed0-8844-eab675c6aefe-kube-api-access-xb2bl\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684661 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f908d57-06d5-4d74-9044-b3e045c36806-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684679 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9648b4c-d83c-4ed0-8844-eab675c6aefe-tmp\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684689 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aa32bba-6dad-4e5d-8959-02f7eeecd506-host-slash\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684739 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgb99\" (UniqueName: \"kubernetes.io/projected/1b432d50-c888-420f-980f-4e7dd474a44a-kube-api-access-bgb99\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684757 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23de7dd-cf78-4151-82bb-1b0c770b1189-cert\") pod \"ingress-canary-jlmzj\" (UID: \"a23de7dd-cf78-4151-82bb-1b0c770b1189\") " pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684771 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-out\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684787 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-k8s-cni-cncf-io\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684809 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-daemon-config\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684824 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f908d57-06d5-4d74-9044-b3e045c36806-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684839 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-systemd-units\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684890 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-slash\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684907 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brwf6\" (UniqueName: \"kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-kube-api-access-brwf6\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684904 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-out\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.684935 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-cni-binary-copy\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.685084 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-modprobe-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.685124 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.685101 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-conf\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.717375 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.717357 5219 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 02:07:35.717428 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:35.717402 5219 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:35.717885 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.717874 5219 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 02:07:35.717914 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:35.717909 5219 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.us-west-1.compute.internal" Nov 04 02:07:35.724943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.724923 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 02:07:35.724979 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.724921 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.724979 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.724952 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 02:07:35.725087 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.725073 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.725546 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.725524 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.725646 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.725626 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-daemon-config\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.725707 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.725686 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h6pb6\"" Nov 04 02:07:35.725831 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.725809 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.725898 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.725830 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.725970 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.725809 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.726092 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.726071 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-db624\"" Nov 04 02:07:35.726334 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.726317 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.726604 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.726582 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 02:07:35.726732 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.726717 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.726837 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.726801 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.726837 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.726723 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 02:07:35.727105 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.726857 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 02:07:35.727105 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727082 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rtznt\"" Nov 04 02:07:35.727344 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727324 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.727427 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727411 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 02:07:35.727532 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727515 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-kn9lr\"" Nov 04 02:07:35.727583 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727417 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.727734 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727719 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 02:07:35.727841 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727824 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-ghp2x\"" Nov 04 02:07:35.727932 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727733 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-8fdm8\"" Nov 04 02:07:35.728003 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727775 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ckptg\"" Nov 04 02:07:35.728003 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727996 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h9jgb\"" Nov 04 02:07:35.728089 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727745 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.728089 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727952 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.728089 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.728075 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 02:07:35.728222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727945 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 02:07:35.728222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.728120 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.728222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.727952 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z899q\"" Nov 04 02:07:35.728222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.728200 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.728406 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.728241 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-szjlx\"" Nov 04 02:07:35.728406 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.728325 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 02:07:35.732450 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.732432 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39f89f68-342c-4b27-a499-43c10f62a478-agent-certs\") pod \"konnectivity-agent-g52g2\" (UID: \"39f89f68-342c-4b27-a499-43c10f62a478\") " pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:07:35.733210 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.733186 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-original-pull-secret\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:35.733300 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.733192 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39f89f68-342c-4b27-a499-43c10f62a478-konnectivity-ca\") pod \"konnectivity-agent-g52g2\" (UID: \"39f89f68-342c-4b27-a499-43c10f62a478\") " pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:07:35.734536 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.734523 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-env-overrides\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.734659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.734646 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aa32bba-6dad-4e5d-8959-02f7eeecd506-iptables-alerter-script\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:07:35.735786 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.735773 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2bef4e-d720-45a8-a182-94ed8805f845-cni-binary-copy\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.756890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.756873 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 04 02:07:35.756943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.756930 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j7wvp\"" Nov 04 02:07:35.757122 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.757110 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 04 02:07:35.757328 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.757316 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-zd6qr\"" Nov 04 02:07:35.757814 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.757802 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 02:07:35.757932 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.757922 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 02:07:35.758071 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.758058 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.758173 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.758162 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.758204 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.758192 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.758251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.758242 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.763097 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.763083 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.763167 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.763154 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.765358 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.765339 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-config\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.774655 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.774640 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 04 02:07:35.775054 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.774979 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 02:07:35.775363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775074 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 02:07:35.775363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775086 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 02:07:35.775363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775114 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 04 02:07:35.775363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775127 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 02:07:35.775363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775134 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.775363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775119 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 02:07:35.775363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775120 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 02:07:35.775363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775208 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 02:07:35.775363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775231 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qq5vw\"" Nov 04 02:07:35.775363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775333 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pzhlz\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775368 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775376 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775424 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775434 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775476 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775478 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775492 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775478 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775514 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xlwps\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775526 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fjjw2\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775560 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775619 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775635 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.775687 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776118 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nm8q\" (UniqueName: \"kubernetes.io/projected/7f908d57-06d5-4d74-9044-b3e045c36806-kube-api-access-4nm8q\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776148 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfpjg\" (UniqueName: \"kubernetes.io/projected/11c1b4b3-e146-441c-b2e1-7ce37ba61863-kube-api-access-wfpjg\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776150 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2lbf\" (UniqueName: \"kubernetes.io/projected/6aa32bba-6dad-4e5d-8959-02f7eeecd506-kube-api-access-c2lbf\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776193 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxnm8\" (UniqueName: \"kubernetes.io/projected/6acaaa12-25fa-4251-8354-17f293e2cc26-kube-api-access-bxnm8\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776203 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kvkfc\"" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776210 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb2bl\" (UniqueName: \"kubernetes.io/projected/c9648b4c-d83c-4ed0-8844-eab675c6aefe-kube-api-access-xb2bl\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776411 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vllk\" (UniqueName: \"kubernetes.io/projected/da56277b-ffe8-4870-a562-26fb88dcc0c3-kube-api-access-5vllk\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776428 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brwf6\" (UniqueName: \"kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-kube-api-access-brwf6\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.776482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776480 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsvc4\" (UniqueName: \"kubernetes.io/projected/a23de7dd-cf78-4151-82bb-1b0c770b1189-kube-api-access-wsvc4\") pod \"ingress-canary-jlmzj\" (UID: \"a23de7dd-cf78-4151-82bb-1b0c770b1189\") " pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:07:35.777306 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776646 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p6pg\" (UniqueName: \"kubernetes.io/projected/0b2bef4e-d720-45a8-a182-94ed8805f845-kube-api-access-2p6pg\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.777306 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776681 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbqtw\" (UniqueName: \"kubernetes.io/projected/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-kube-api-access-bbqtw\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:35.777306 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.776680 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgb99\" (UniqueName: \"kubernetes.io/projected/1b432d50-c888-420f-980f-4e7dd474a44a-kube-api-access-bgb99\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.782147 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.782131 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b432d50-c888-420f-980f-4e7dd474a44a-ovn-node-metrics-cert\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.782241 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.782210 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-accelerators-collector-config\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.782360 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.782344 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-web-config\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.783410 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.783390 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-tls\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.783513 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.783405 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-metrics-tls\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:35.783513 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.783420 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.783513 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.783426 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.783513 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.783417 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41a3ab36-e89b-4428-ad86-ab439ef4ca6a-config-volume\") pod \"dns-default-2zhl2\" (UID: \"41a3ab36-e89b-4428-ad86-ab439ef4ca6a\") " pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:35.783513 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.783407 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.783513 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.783508 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61936444-21d0-45a0-b2b2-57cdcd514f3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.783903 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.783883 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c1b4b3-e146-441c-b2e1-7ce37ba61863-metrics-client-ca\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.784263 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.784242 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b432d50-c888-420f-980f-4e7dd474a44a-ovnkube-script-lib\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.784359 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.784238 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.784510 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.784491 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61936444-21d0-45a0-b2b2-57cdcd514f3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.784648 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.784631 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.785262 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785243 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61936444-21d0-45a0-b2b2-57cdcd514f3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61936444-21d0-45a0-b2b2-57cdcd514f3a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 02:07:35.785262 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785256 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f908d57-06d5-4d74-9044-b3e045c36806-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.785400 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785245 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f908d57-06d5-4d74-9044-b3e045c36806-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.785400 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785247 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23de7dd-cf78-4151-82bb-1b0c770b1189-cert\") pod \"ingress-canary-jlmzj\" (UID: \"a23de7dd-cf78-4151-82bb-1b0c770b1189\") " pod="openshift-ingress-canary/ingress-canary-jlmzj" Nov 04 02:07:35.785400 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785340 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm84k\" (UniqueName: \"kubernetes.io/projected/2cbe4ad0-7162-4e44-af92-3a3449226a55-kube-api-access-wm84k\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:07:35.785400 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785356 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-device-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.785400 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785380 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-bin\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785430 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-device-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785458 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-run\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785493 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-run\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785534 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-bin\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785559 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-system-cni-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785575 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-node-log\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785595 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-system-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785617 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-netns\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785617 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-system-cni-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785622 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-node-log\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785639 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-sys-fs\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.785658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785661 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-system-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785668 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-systemd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785677 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-netns\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785683 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-sys-fs\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785687 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-etc-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785714 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-etc-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785718 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-systemd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785742 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785781 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-cni-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785789 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-cnibin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785808 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-multus-certs\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785812 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-cnibin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785823 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-netns\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785835 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-multus-certs\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785837 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-kubelet\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785851 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysconfig\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785856 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-netns\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785867 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785877 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-kubelet\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785884 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-registration-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785912 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-registration-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785911 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-var-lib-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785934 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-kubelet\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785924 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysconfig\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785945 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-var-lib-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785961 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-systemd\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785976 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aa32bba-6dad-4e5d-8959-02f7eeecd506-host-slash\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785964 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-kubelet\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.785990 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-k8s-cni-cncf-io\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786003 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-systemd\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786014 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwrkj\" (UniqueName: \"kubernetes.io/projected/3a874e0e-2ae1-4716-a5ca-6faf7033f145-kube-api-access-gwrkj\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786023 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aa32bba-6dad-4e5d-8959-02f7eeecd506-host-slash\") pod \"iptables-alerter-59cvz\" (UID: \"6aa32bba-6dad-4e5d-8959-02f7eeecd506\") " pod="openshift-network-operator/iptables-alerter-59cvz" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786040 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-run-k8s-cni-cncf-io\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786046 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-netd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786028 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-cni-netd\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786077 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786101 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a874e0e-2ae1-4716-a5ca-6faf7033f145-host\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786115 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-openvswitch\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.786115 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786121 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-dbus\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786147 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786171 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-lib-modules\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786185 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-host\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786186 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-dbus\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786199 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786201 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786217 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786232 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786250 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-host\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786257 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-run-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786279 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-conf-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786316 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786326 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-lib-modules\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786330 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6acaaa12-25fa-4251-8354-17f293e2cc26-hosts-file\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786328 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-conf-dir\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786358 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6acaaa12-25fa-4251-8354-17f293e2cc26-hosts-file\") pod \"node-resolver-f9dj5\" (UID: \"6acaaa12-25fa-4251-8354-17f293e2cc26\") " pod="openshift-dns/node-resolver-f9dj5" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786362 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786367 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mwj\" (UniqueName: \"kubernetes.io/projected/91a1bffe-aa40-4eea-8941-3dc7851929ee-kube-api-access-45mwj\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786391 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786406 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-socket-dir-parent\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786407 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786419 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-hostroot\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786424 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cbe4ad0-7162-4e44-af92-3a3449226a55-metrics-certs\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786433 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-var-lib-kubelet\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786468 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-hostroot\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786471 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-multus-socket-dir-parent\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786468 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-var-lib-kubelet\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786484 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-wtmp\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786504 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-multus\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786518 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-sys\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786533 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-log-socket\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786563 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-multus\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786567 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-kubernetes\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786574 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-log-socket\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786579 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-node-exporter-wtmp\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786597 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-cnibin\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786604 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-sys\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786610 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786623 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786645 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-ovn\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786625 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-kubernetes\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786666 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786689 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786692 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-run-ovn\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786693 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786727 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786732 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786752 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-systemd-units\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786774 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-slash\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786822 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-modprobe-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786846 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-conf\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786859 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a1bffe-aa40-4eea-8941-3dc7851929ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786864 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-host-slash\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786856 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b432d50-c888-420f-980f-4e7dd474a44a-systemd-units\") pod \"ovnkube-node-kbkqw\" (UID: \"1b432d50-c888-420f-980f-4e7dd474a44a\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786868 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a874e0e-2ae1-4716-a5ca-6faf7033f145-serviceca\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786950 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-modprobe-d\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786951 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f908d57-06d5-4d74-9044-b3e045c36806-crio-socket\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786988 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-sys\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787010 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-root\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787017 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-sys\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786987 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f908d57-06d5-4d74-9044-b3e045c36806-crio-socket\") pod \"insights-runtime-extractor-8f6tb\" (UID: \"7f908d57-06d5-4d74-9044-b3e045c36806\") " pod="openshift-insights/insights-runtime-extractor-8f6tb" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787060 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11c1b4b3-e146-441c-b2e1-7ce37ba61863-root\") pod \"node-exporter-kv495\" (UID: \"11c1b4b3-e146-441c-b2e1-7ce37ba61863\") " pod="openshift-monitoring/node-exporter-kv495" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787066 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-bin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.786966 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9648b4c-d83c-4ed0-8844-eab675c6aefe-etc-sysctl-conf\") pod \"tuned-5zgbq\" (UID: \"c9648b4c-d83c-4ed0-8844-eab675c6aefe\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgbq" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787034 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-host-var-lib-cni-bin\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787095 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-etc-kubernetes\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787126 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-socket-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787140 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-kubelet-config\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787153 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b2bef4e-d720-45a8-a182-94ed8805f845-etc-kubernetes\") pod \"multus-b4zjs\" (UID: \"0b2bef4e-d720-45a8-a182-94ed8805f845\") " pod="openshift-multus/multus-b4zjs" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787161 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a874e0e-2ae1-4716-a5ca-6faf7033f145-serviceca\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787189 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7cc9b6d-5ad9-4c08-b523-acee6c40a031-kubelet-config\") pod \"global-pull-secret-syncer-ftvnd\" (UID: \"c7cc9b6d-5ad9-4c08-b523-acee6c40a031\") " pod="kube-system/global-pull-secret-syncer-ftvnd" Nov 04 02:07:35.787778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.787193 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da56277b-ffe8-4870-a562-26fb88dcc0c3-socket-dir\") pod \"aws-ebs-csi-driver-node-rhg8w\" (UID: \"da56277b-ffe8-4870-a562-26fb88dcc0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhg8w" Nov 04 02:07:35.843577 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.843530 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm84k\" (UniqueName: \"kubernetes.io/projected/2cbe4ad0-7162-4e44-af92-3a3449226a55-kube-api-access-wm84k\") pod \"network-metrics-daemon-rm28p\" (UID: \"2cbe4ad0-7162-4e44-af92-3a3449226a55\") " pod="openshift-multus/network-metrics-daemon-rm28p" Nov 04 02:07:35.844847 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.844826 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd962\" (UniqueName: \"kubernetes.io/projected/a50b6ca7-2a42-4dff-a86e-0e73749997cc-kube-api-access-hd962\") pod \"network-check-target-wrp97\" (UID: \"a50b6ca7-2a42-4dff-a86e-0e73749997cc\") " pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:07:35.848664 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.848646 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwrkj\" (UniqueName: \"kubernetes.io/projected/3a874e0e-2ae1-4716-a5ca-6faf7033f145-kube-api-access-gwrkj\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:07:35.849777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.849757 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45mwj\" (UniqueName: \"kubernetes.io/projected/91a1bffe-aa40-4eea-8941-3dc7851929ee-kube-api-access-45mwj\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.887471 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.887445 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.887582 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.887475 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a874e0e-2ae1-4716-a5ca-6faf7033f145-host\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:07:35.887582 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.887498 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-cnibin\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.887582 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.887520 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:35.887582 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.887531 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a874e0e-2ae1-4716-a5ca-6faf7033f145-host\") pod \"node-ca-pd9w7\" (UID: \"3a874e0e-2ae1-4716-a5ca-6faf7033f145\") " pod="openshift-image-registry/node-ca-pd9w7" Nov 04 02:07:35.887582 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:35.887567 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a1bffe-aa40-4eea-8941-3dc7851929ee-cnibin\") pod \"multus-additional-cni-plugins-jc6hh\" (UID: \"91a1bffe-aa40-4eea-8941-3dc7851929ee\") " pod="openshift-multus/multus-additional-cni-plugins-jc6hh" Nov 04 02:07:37.770834 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:37.770802 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2zhl2" Nov 04 02:07:37.821552 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:37.821529 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:38.928019 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:07:38.927985 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:07:42.228614 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:42.228581 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:07:44.618274 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:44.618245 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:07:44.618739 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:44.618453 5219 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 02:07:45.237299 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:45.237272 5219 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-225.us-west-1.compute.internal" event="NodeReady" Nov 04 02:07:49.500798 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:49.500764 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g52g2" Nov 04 02:07:52.941478 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:07:52.941453 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbkqw" Nov 04 02:08:02.231732 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:08:02.231693 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wrp97" Nov 04 02:08:08.929046 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:08:08.929010 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:08:38.929517 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:08:38.929477 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:09:08.929412 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:09:08.929374 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:09:25.145411 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.145375 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9"] Nov 04 02:09:25.147379 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.147360 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.182881 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.182854 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.183010 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.182887 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq9vr\" (UniqueName: \"kubernetes.io/projected/06e5afa9-5118-42ec-b7c4-205cc9d2a067-kube-api-access-qq9vr\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.183010 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.182915 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.214831 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.214743 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 04 02:09:25.264150 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.264116 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 04 02:09:25.264318 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.264268 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-sgmgc\"" Nov 04 02:09:25.264596 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.264578 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9"] Nov 04 02:09:25.284251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.284220 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.284415 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.284282 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.284415 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.284345 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9vr\" (UniqueName: \"kubernetes.io/projected/06e5afa9-5118-42ec-b7c4-205cc9d2a067-kube-api-access-qq9vr\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.284713 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.284691 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.284792 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.284698 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.343055 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.343027 5219 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 02:09:25.345352 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.345336 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9vr\" (UniqueName: \"kubernetes.io/projected/06e5afa9-5118-42ec-b7c4-205cc9d2a067-kube-api-access-qq9vr\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.458380 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.458347 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:25.664339 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.664315 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh"] Nov 04 02:09:25.666160 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.666144 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.686653 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.686631 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.686763 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.686664 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpzqm\" (UniqueName: \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-kube-api-access-zpzqm\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.686763 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.686686 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.686842 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.686787 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.686842 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.686830 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.686912 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.686854 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.686952 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.686920 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.719863 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.719811 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Nov 04 02:09:25.720754 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.720738 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 02:09:25.720839 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.720826 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 04 02:09:25.727578 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.727561 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 02:09:25.739088 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.739032 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh"] Nov 04 02:09:25.787914 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.787892 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.788041 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.787927 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.788041 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.787962 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.788041 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.787989 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.788156 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.788136 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.788223 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.788176 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.788312 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.788272 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpzqm\" (UniqueName: \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-kube-api-access-zpzqm\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.788705 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.788683 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.790204 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.790178 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.790415 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.790400 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.820857 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.820837 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Nov 04 02:09:25.820946 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.820883 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Nov 04 02:09:25.820946 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.820942 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tvtxq\"" Nov 04 02:09:25.830929 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.830911 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.830929 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.830919 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.848562 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.848543 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpzqm\" (UniqueName: \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-kube-api-access-zpzqm\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.848651 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.848548 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-mk6kh\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.856383 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.856365 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9"] Nov 04 02:09:25.860698 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:09:25.860666 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e5afa9_5118_42ec_b7c4_205cc9d2a067.slice/crio-1645a629d6a4599d85d73f60c4c9bbbdd8d4b580c966d179da46781026abd02d WatchSource:0}: Error finding container 1645a629d6a4599d85d73f60c4c9bbbdd8d4b580c966d179da46781026abd02d: Status 404 returned error can't find the container with id 1645a629d6a4599d85d73f60c4c9bbbdd8d4b580c966d179da46781026abd02d Nov 04 02:09:25.862637 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.862623 5219 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 02:09:25.975609 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.975551 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:25.987027 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:25.987003 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" event={"ID":"06e5afa9-5118-42ec-b7c4-205cc9d2a067","Type":"ContainerStarted","Data":"1645a629d6a4599d85d73f60c4c9bbbdd8d4b580c966d179da46781026abd02d"} Nov 04 02:09:26.397267 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:26.397185 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh"] Nov 04 02:09:26.401103 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:09:26.401077 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e935cc0_d6c3_4ed6_89be_dc97e9deedfe.slice/crio-1d659bdeff6bb3880107a2f21f0f6f0c15ff6feb17f9fffd3f7f05928633bb01 WatchSource:0}: Error finding container 1d659bdeff6bb3880107a2f21f0f6f0c15ff6feb17f9fffd3f7f05928633bb01: Status 404 returned error can't find the container with id 1d659bdeff6bb3880107a2f21f0f6f0c15ff6feb17f9fffd3f7f05928633bb01 Nov 04 02:09:26.992551 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:26.992514 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" event={"ID":"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe","Type":"ContainerStarted","Data":"1d659bdeff6bb3880107a2f21f0f6f0c15ff6feb17f9fffd3f7f05928633bb01"} Nov 04 02:09:30.961019 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:30.960979 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:09:30.961396 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:30.961061 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:09:32.014654 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:32.014613 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" event={"ID":"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe","Type":"ContainerStarted","Data":"b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f"} Nov 04 02:09:32.015141 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:32.014887 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:32.016459 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:32.016435 5219 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-mk6kh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 02:09:32.016643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:32.016481 5219 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" podUID="7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 02:09:32.220730 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:32.220662 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" podStartSLOduration=2.663701408 podStartE2EDuration="7.220648151s" totalImagesPullingTime="4.556946743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:09:32.183859658 +0000 UTC m=+117.672368358" watchObservedRunningTime="2026-11-04 02:09:32.220648151 +0000 UTC m=+117.709156851" Nov 04 02:09:33.019765 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:33.019729 5219 generic.go:356] "Generic (PLEG): container finished" podID="06e5afa9-5118-42ec-b7c4-205cc9d2a067" containerID="a7c9b3ae5154416f4c2058e34eba2cb3e914509be20f41858e29ac7786f6c135" exitCode=0 Nov 04 02:09:33.020152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:33.019812 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" event={"ID":"06e5afa9-5118-42ec-b7c4-205cc9d2a067","Type":"ContainerDied","Data":"a7c9b3ae5154416f4c2058e34eba2cb3e914509be20f41858e29ac7786f6c135"} Nov 04 02:09:33.020604 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:33.020582 5219 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-mk6kh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 02:09:33.020704 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:33.020635 5219 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" podUID="7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 02:09:35.028727 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:35.028689 5219 generic.go:356] "Generic (PLEG): container finished" podID="06e5afa9-5118-42ec-b7c4-205cc9d2a067" containerID="ca458c5c5df470f648d7ea3bb3f468a81daa16dc6d46fdde6e5d4e557869fbc3" exitCode=0 Nov 04 02:09:35.029109 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:35.028774 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" event={"ID":"06e5afa9-5118-42ec-b7c4-205cc9d2a067","Type":"ContainerDied","Data":"ca458c5c5df470f648d7ea3bb3f468a81daa16dc6d46fdde6e5d4e557869fbc3"} Nov 04 02:09:36.021025 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:36.020992 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:09:38.928502 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:09:38.928467 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:09:43.057028 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:43.056991 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" event={"ID":"06e5afa9-5118-42ec-b7c4-205cc9d2a067","Type":"ContainerStarted","Data":"5a9754e97577ddcb551448feaa30fbf06ebbb6a65ade93439d15b7fd2f8e236c"} Nov 04 02:09:43.174824 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:43.174771 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" podStartSLOduration=2.910833627 podStartE2EDuration="18.174756789s" totalImagesPullingTime="15.263923162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:09:43.174348384 +0000 UTC m=+128.662857083" watchObservedRunningTime="2026-11-04 02:09:43.174756789 +0000 UTC m=+128.663265520" Nov 04 02:09:44.062016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:44.061982 5219 generic.go:356] "Generic (PLEG): container finished" podID="06e5afa9-5118-42ec-b7c4-205cc9d2a067" containerID="5a9754e97577ddcb551448feaa30fbf06ebbb6a65ade93439d15b7fd2f8e236c" exitCode=0 Nov 04 02:09:44.062411 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:44.062039 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" event={"ID":"06e5afa9-5118-42ec-b7c4-205cc9d2a067","Type":"ContainerDied","Data":"5a9754e97577ddcb551448feaa30fbf06ebbb6a65ade93439d15b7fd2f8e236c"} Nov 04 02:09:45.184157 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:45.184133 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:45.238561 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:45.238535 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-util\" (UniqueName: \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-util\") pod \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " Nov 04 02:09:45.238685 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:45.238587 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-bundle\" (UniqueName: \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-bundle\") pod \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " Nov 04 02:09:45.238685 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:45.238627 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06e5afa9-5118-42ec-b7c4-205cc9d2a067-kube-api-access-qq9vr\" (UniqueName: \"kubernetes.io/projected/06e5afa9-5118-42ec-b7c4-205cc9d2a067-kube-api-access-qq9vr\") pod \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\" (UID: \"06e5afa9-5118-42ec-b7c4-205cc9d2a067\") " Nov 04 02:09:45.239077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:45.239055 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-bundle" pod "06e5afa9-5118-42ec-b7c4-205cc9d2a067" (UID: "06e5afa9-5118-42ec-b7c4-205cc9d2a067"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:09:45.240925 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:45.240901 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e5afa9-5118-42ec-b7c4-205cc9d2a067-kube-api-access-qq9vr" pod "06e5afa9-5118-42ec-b7c4-205cc9d2a067" (UID: "06e5afa9-5118-42ec-b7c4-205cc9d2a067"). InnerVolumeSpecName "kube-api-access-qq9vr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:09:45.242969 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:45.242945 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-util" pod "06e5afa9-5118-42ec-b7c4-205cc9d2a067" (UID: "06e5afa9-5118-42ec-b7c4-205cc9d2a067"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:09:45.339360 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:45.339278 5219 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-util\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:09:45.339360 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:45.339318 5219 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06e5afa9-5118-42ec-b7c4-205cc9d2a067-bundle\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:09:45.339360 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:45.339328 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq9vr\" (UniqueName: \"kubernetes.io/projected/06e5afa9-5118-42ec-b7c4-205cc9d2a067-kube-api-access-qq9vr\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:09:46.069561 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:46.069526 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" event={"ID":"06e5afa9-5118-42ec-b7c4-205cc9d2a067","Type":"ContainerDied","Data":"1645a629d6a4599d85d73f60c4c9bbbdd8d4b580c966d179da46781026abd02d"} Nov 04 02:09:46.069561 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:46.069551 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71mhjr9" Nov 04 02:09:46.069762 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:09:46.069572 5219 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1645a629d6a4599d85d73f60c4c9bbbdd8d4b580c966d179da46781026abd02d" Nov 04 02:10:08.929269 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:10:08.929220 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:10:17.872009 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.871977 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2"] Nov 04 02:10:17.872399 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.872209 5219 cpu_manager.go:414] "containerMap: removing container" podUID="06e5afa9-5118-42ec-b7c4-205cc9d2a067" containerName="extract" Nov 04 02:10:17.872399 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.872220 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06e5afa9-5118-42ec-b7c4-205cc9d2a067" containerName="extract" Nov 04 02:10:17.872399 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.872245 5219 cpu_manager.go:414] "containerMap: removing container" podUID="06e5afa9-5118-42ec-b7c4-205cc9d2a067" containerName="util" Nov 04 02:10:17.872399 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.872250 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06e5afa9-5118-42ec-b7c4-205cc9d2a067" containerName="util" Nov 04 02:10:17.872399 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.872255 5219 cpu_manager.go:414] "containerMap: removing container" podUID="06e5afa9-5118-42ec-b7c4-205cc9d2a067" containerName="pull" Nov 04 02:10:17.872399 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.872260 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06e5afa9-5118-42ec-b7c4-205cc9d2a067" containerName="pull" Nov 04 02:10:17.872399 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.872317 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="06e5afa9-5118-42ec-b7c4-205cc9d2a067" containerName="extract" Nov 04 02:10:17.873932 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.873916 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:17.956702 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.956670 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/839cd763-90c9-43fd-9a1c-a04b0429b7b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:17.956702 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.956703 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/839cd763-90c9-43fd-9a1c-a04b0429b7b3-manifests\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:17.956876 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.956727 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/839cd763-90c9-43fd-9a1c-a04b0429b7b3-metrics-cert\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:17.956876 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.956824 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/839cd763-90c9-43fd-9a1c-a04b0429b7b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:17.956876 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.956855 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzbnc\" (UniqueName: \"kubernetes.io/projected/839cd763-90c9-43fd-9a1c-a04b0429b7b3-kube-api-access-tzbnc\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:17.956966 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:17.956895 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/839cd763-90c9-43fd-9a1c-a04b0429b7b3-tmp\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.002466 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.002434 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 04 02:10:18.002657 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.002639 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 04 02:10:18.002714 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.002658 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-6rb58\"" Nov 04 02:10:18.002714 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.002645 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 04 02:10:18.002714 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.002682 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 04 02:10:18.002823 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.002746 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 04 02:10:18.013648 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.013615 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2"] Nov 04 02:10:18.058087 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.058058 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/839cd763-90c9-43fd-9a1c-a04b0429b7b3-tmp\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.058254 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.058102 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/839cd763-90c9-43fd-9a1c-a04b0429b7b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.058254 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.058121 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/839cd763-90c9-43fd-9a1c-a04b0429b7b3-manifests\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.058254 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.058160 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/839cd763-90c9-43fd-9a1c-a04b0429b7b3-metrics-cert\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.058254 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.058183 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/839cd763-90c9-43fd-9a1c-a04b0429b7b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.058254 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.058211 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzbnc\" (UniqueName: \"kubernetes.io/projected/839cd763-90c9-43fd-9a1c-a04b0429b7b3-kube-api-access-tzbnc\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.058624 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.058599 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/839cd763-90c9-43fd-9a1c-a04b0429b7b3-manifests\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.060620 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.060592 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/839cd763-90c9-43fd-9a1c-a04b0429b7b3-tmp\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.060753 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.060734 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/839cd763-90c9-43fd-9a1c-a04b0429b7b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.060926 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.060906 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/839cd763-90c9-43fd-9a1c-a04b0429b7b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.060986 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.060916 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/839cd763-90c9-43fd-9a1c-a04b0429b7b3-metrics-cert\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.120053 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.120023 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzbnc\" (UniqueName: \"kubernetes.io/projected/839cd763-90c9-43fd-9a1c-a04b0429b7b3-kube-api-access-tzbnc\") pod \"opendatahub-operator-controller-manager-647c5cc759-phqq2\" (UID: \"839cd763-90c9-43fd-9a1c-a04b0429b7b3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.185440 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.185412 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:18.675376 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:18.675342 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2"] Nov 04 02:10:18.682686 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:10:18.682653 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839cd763_90c9_43fd_9a1c_a04b0429b7b3.slice/crio-97c539fdc1313cf9ad4ef5c526ba51d2125a7dffb66f4aae57ffee4d1265a9e2 WatchSource:0}: Error finding container 97c539fdc1313cf9ad4ef5c526ba51d2125a7dffb66f4aae57ffee4d1265a9e2: Status 404 returned error can't find the container with id 97c539fdc1313cf9ad4ef5c526ba51d2125a7dffb66f4aae57ffee4d1265a9e2 Nov 04 02:10:19.178568 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:19.178537 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" event={"ID":"839cd763-90c9-43fd-9a1c-a04b0429b7b3","Type":"ContainerStarted","Data":"97c539fdc1313cf9ad4ef5c526ba51d2125a7dffb66f4aae57ffee4d1265a9e2"} Nov 04 02:10:23.196114 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:23.196086 5219 generic.go:356] "Generic (PLEG): container finished" podID="839cd763-90c9-43fd-9a1c-a04b0429b7b3" containerID="16a1d9a8f276cfe14720747e8b9ae8c5ac5497609fb979162cb0edcd0488e203" exitCode=0 Nov 04 02:10:23.196491 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:23.196167 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" event={"ID":"839cd763-90c9-43fd-9a1c-a04b0429b7b3","Type":"ContainerDied","Data":"16a1d9a8f276cfe14720747e8b9ae8c5ac5497609fb979162cb0edcd0488e203"} Nov 04 02:10:25.205261 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:25.205223 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" event={"ID":"839cd763-90c9-43fd-9a1c-a04b0429b7b3","Type":"ContainerStarted","Data":"9005c2fbe4dc02724960816414e5705f4330eb064eb44ba0fd38c0e2014bb10a"} Nov 04 02:10:25.205750 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:25.205348 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:25.495258 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:25.495137 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" podStartSLOduration=3.432005472 podStartE2EDuration="8.495118078s" totalImagesPullingTime="4.617262289s" totalInitContainerRuntime="445.850317ms" isStatefulPod=false podCreationTimestamp="2026-11-04 02:10:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:10:25.493752112 +0000 UTC m=+170.982260824" watchObservedRunningTime="2026-11-04 02:10:25.495118078 +0000 UTC m=+170.983626779" Nov 04 02:10:36.210483 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:36.210453 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-647c5cc759-phqq2" Nov 04 02:10:37.892092 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:37.892060 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46"] Nov 04 02:10:37.898100 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:37.898077 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" Nov 04 02:10:37.959027 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:37.958980 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Nov 04 02:10:37.959187 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:37.959038 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mg8jr\"" Nov 04 02:10:37.959187 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:37.959076 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Nov 04 02:10:37.959187 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:37.959066 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46"] Nov 04 02:10:38.004572 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:38.004544 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62d7cc3a-fd4e-4358-9184-43db843de40c-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-v6s46\" (UID: \"62d7cc3a-fd4e-4358-9184-43db843de40c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" Nov 04 02:10:38.004713 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:38.004633 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s84vg\" (UniqueName: \"kubernetes.io/projected/62d7cc3a-fd4e-4358-9184-43db843de40c-kube-api-access-s84vg\") pod \"cert-manager-webhook-5dbbbf75cc-v6s46\" (UID: \"62d7cc3a-fd4e-4358-9184-43db843de40c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" Nov 04 02:10:38.105302 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:38.105249 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s84vg\" (UniqueName: \"kubernetes.io/projected/62d7cc3a-fd4e-4358-9184-43db843de40c-kube-api-access-s84vg\") pod \"cert-manager-webhook-5dbbbf75cc-v6s46\" (UID: \"62d7cc3a-fd4e-4358-9184-43db843de40c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" Nov 04 02:10:38.105467 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:38.105310 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62d7cc3a-fd4e-4358-9184-43db843de40c-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-v6s46\" (UID: \"62d7cc3a-fd4e-4358-9184-43db843de40c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" Nov 04 02:10:38.170485 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:38.170425 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62d7cc3a-fd4e-4358-9184-43db843de40c-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-v6s46\" (UID: \"62d7cc3a-fd4e-4358-9184-43db843de40c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" Nov 04 02:10:38.170485 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:38.170425 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s84vg\" (UniqueName: \"kubernetes.io/projected/62d7cc3a-fd4e-4358-9184-43db843de40c-kube-api-access-s84vg\") pod \"cert-manager-webhook-5dbbbf75cc-v6s46\" (UID: \"62d7cc3a-fd4e-4358-9184-43db843de40c\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" Nov 04 02:10:38.218617 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:38.218592 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" Nov 04 02:10:38.586614 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:38.586575 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46"] Nov 04 02:10:38.590239 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:10:38.590215 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62d7cc3a_fd4e_4358_9184_43db843de40c.slice/crio-84830804b76b2732e4c812f924a70a332ce97425aa22c3faca1b38d6c394e8c0 WatchSource:0}: Error finding container 84830804b76b2732e4c812f924a70a332ce97425aa22c3faca1b38d6c394e8c0: Status 404 returned error can't find the container with id 84830804b76b2732e4c812f924a70a332ce97425aa22c3faca1b38d6c394e8c0 Nov 04 02:10:38.929460 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:10:38.929432 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:10:39.257963 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:39.257886 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" event={"ID":"62d7cc3a-fd4e-4358-9184-43db843de40c","Type":"ContainerStarted","Data":"84830804b76b2732e4c812f924a70a332ce97425aa22c3faca1b38d6c394e8c0"} Nov 04 02:10:41.235080 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.235045 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82"] Nov 04 02:10:41.239264 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.239246 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.293565 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.293543 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 04 02:10:41.330913 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.330878 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8dd92c9e-2153-46ea-a18a-e94a24eca569-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-wlj82\" (UID: \"8dd92c9e-2153-46ea-a18a-e94a24eca569\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.331044 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.330923 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dd92c9e-2153-46ea-a18a-e94a24eca569-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-wlj82\" (UID: \"8dd92c9e-2153-46ea-a18a-e94a24eca569\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.331044 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.330982 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz5p2\" (UniqueName: \"kubernetes.io/projected/8dd92c9e-2153-46ea-a18a-e94a24eca569-kube-api-access-kz5p2\") pod \"kuadrant-console-plugin-66c4fb575d-wlj82\" (UID: \"8dd92c9e-2153-46ea-a18a-e94a24eca569\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.342839 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.342819 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Nov 04 02:10:41.342839 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.342831 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Nov 04 02:10:41.343100 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.343086 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 04 02:10:41.343144 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.343105 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nx77b\"" Nov 04 02:10:41.343745 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.343731 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82"] Nov 04 02:10:41.432111 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.432085 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8dd92c9e-2153-46ea-a18a-e94a24eca569-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-wlj82\" (UID: \"8dd92c9e-2153-46ea-a18a-e94a24eca569\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.432252 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.432124 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dd92c9e-2153-46ea-a18a-e94a24eca569-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-wlj82\" (UID: \"8dd92c9e-2153-46ea-a18a-e94a24eca569\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.432252 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.432149 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz5p2\" (UniqueName: \"kubernetes.io/projected/8dd92c9e-2153-46ea-a18a-e94a24eca569-kube-api-access-kz5p2\") pod \"kuadrant-console-plugin-66c4fb575d-wlj82\" (UID: \"8dd92c9e-2153-46ea-a18a-e94a24eca569\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.432711 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.432696 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8dd92c9e-2153-46ea-a18a-e94a24eca569-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-wlj82\" (UID: \"8dd92c9e-2153-46ea-a18a-e94a24eca569\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.434684 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.434653 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dd92c9e-2153-46ea-a18a-e94a24eca569-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-wlj82\" (UID: \"8dd92c9e-2153-46ea-a18a-e94a24eca569\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.492706 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.492647 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz5p2\" (UniqueName: \"kubernetes.io/projected/8dd92c9e-2153-46ea-a18a-e94a24eca569-kube-api-access-kz5p2\") pod \"kuadrant-console-plugin-66c4fb575d-wlj82\" (UID: \"8dd92c9e-2153-46ea-a18a-e94a24eca569\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.554854 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.554825 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" Nov 04 02:10:41.933771 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:41.933745 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82"] Nov 04 02:10:41.937727 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:10:41.937703 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dd92c9e_2153_46ea_a18a_e94a24eca569.slice/crio-4960620a9b3e4973a45336e70fcd3fa5f58e2ae24360b15b13fd2e00063fd632 WatchSource:0}: Error finding container 4960620a9b3e4973a45336e70fcd3fa5f58e2ae24360b15b13fd2e00063fd632: Status 404 returned error can't find the container with id 4960620a9b3e4973a45336e70fcd3fa5f58e2ae24360b15b13fd2e00063fd632 Nov 04 02:10:42.268451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:42.268372 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" event={"ID":"8dd92c9e-2153-46ea-a18a-e94a24eca569","Type":"ContainerStarted","Data":"4960620a9b3e4973a45336e70fcd3fa5f58e2ae24360b15b13fd2e00063fd632"} Nov 04 02:10:49.712001 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.711952 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wrxqt"] Nov 04 02:10:49.715034 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.715016 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:10:49.790464 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.790441 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Nov 04 02:10:49.792616 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.792594 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wrxqt"] Nov 04 02:10:49.796881 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.796858 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q47k8\" (UniqueName: \"kubernetes.io/projected/72c0fcc2-6573-4707-b446-0976f7213131-kube-api-access-q47k8\") pod \"limitador-limitador-74dfcfb894-wrxqt\" (UID: \"72c0fcc2-6573-4707-b446-0976f7213131\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:10:49.796982 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.796927 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72c0fcc2-6573-4707-b446-0976f7213131-config-file\") pod \"limitador-limitador-74dfcfb894-wrxqt\" (UID: \"72c0fcc2-6573-4707-b446-0976f7213131\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:10:49.898213 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.898173 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q47k8\" (UniqueName: \"kubernetes.io/projected/72c0fcc2-6573-4707-b446-0976f7213131-kube-api-access-q47k8\") pod \"limitador-limitador-74dfcfb894-wrxqt\" (UID: \"72c0fcc2-6573-4707-b446-0976f7213131\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:10:49.898393 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.898262 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72c0fcc2-6573-4707-b446-0976f7213131-config-file\") pod \"limitador-limitador-74dfcfb894-wrxqt\" (UID: \"72c0fcc2-6573-4707-b446-0976f7213131\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:10:49.898899 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.898877 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72c0fcc2-6573-4707-b446-0976f7213131-config-file\") pod \"limitador-limitador-74dfcfb894-wrxqt\" (UID: \"72c0fcc2-6573-4707-b446-0976f7213131\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:10:49.951110 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.951082 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wrxqt"] Nov 04 02:10:49.976921 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:49.976859 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q47k8\" (UniqueName: \"kubernetes.io/projected/72c0fcc2-6573-4707-b446-0976f7213131-kube-api-access-q47k8\") pod \"limitador-limitador-74dfcfb894-wrxqt\" (UID: \"72c0fcc2-6573-4707-b446-0976f7213131\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:10:50.027097 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:50.027067 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:10:50.299780 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:50.299706 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" event={"ID":"8dd92c9e-2153-46ea-a18a-e94a24eca569","Type":"ContainerStarted","Data":"3b6e2e543b70916ed592f4e9cd0c13d262224b80bfad506405a40a697f6f33e0"} Nov 04 02:10:50.425072 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:50.425045 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wrxqt"] Nov 04 02:10:50.428104 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:10:50.428071 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c0fcc2_6573_4707_b446_0976f7213131.slice/crio-9317b41c10b17d54c7232f339585aeab011768093878eaca3e79689a9fa7ed0e WatchSource:0}: Error finding container 9317b41c10b17d54c7232f339585aeab011768093878eaca3e79689a9fa7ed0e: Status 404 returned error can't find the container with id 9317b41c10b17d54c7232f339585aeab011768093878eaca3e79689a9fa7ed0e Nov 04 02:10:50.430125 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:50.429952 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wlj82" podStartSLOduration=1.622560671 podStartE2EDuration="9.429934533s" totalImagesPullingTime="7.807373862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:10:50.429214116 +0000 UTC m=+195.917722815" watchObservedRunningTime="2026-11-04 02:10:50.429934533 +0000 UTC m=+195.918443236" Nov 04 02:10:51.304348 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:51.304315 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" event={"ID":"72c0fcc2-6573-4707-b446-0976f7213131","Type":"ContainerStarted","Data":"9317b41c10b17d54c7232f339585aeab011768093878eaca3e79689a9fa7ed0e"} Nov 04 02:10:51.413189 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:51.413153 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-4rjrr"] Nov 04 02:10:51.417459 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:51.417442 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-4rjrr" Nov 04 02:10:51.471762 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:51.471730 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-4rjrr"] Nov 04 02:10:51.474446 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:51.474427 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5nx9g\"" Nov 04 02:10:51.512132 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:51.512103 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4njd\" (UniqueName: \"kubernetes.io/projected/b30b14a3-30a1-4c84-a429-caf63c0eb4ff-kube-api-access-n4njd\") pod \"authorino-57f7f8659f-4rjrr\" (UID: \"b30b14a3-30a1-4c84-a429-caf63c0eb4ff\") " pod="kuadrant-system/authorino-57f7f8659f-4rjrr" Nov 04 02:10:51.613004 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:51.612918 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4njd\" (UniqueName: \"kubernetes.io/projected/b30b14a3-30a1-4c84-a429-caf63c0eb4ff-kube-api-access-n4njd\") pod \"authorino-57f7f8659f-4rjrr\" (UID: \"b30b14a3-30a1-4c84-a429-caf63c0eb4ff\") " pod="kuadrant-system/authorino-57f7f8659f-4rjrr" Nov 04 02:10:51.673684 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:51.673656 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4njd\" (UniqueName: \"kubernetes.io/projected/b30b14a3-30a1-4c84-a429-caf63c0eb4ff-kube-api-access-n4njd\") pod \"authorino-57f7f8659f-4rjrr\" (UID: \"b30b14a3-30a1-4c84-a429-caf63c0eb4ff\") " pod="kuadrant-system/authorino-57f7f8659f-4rjrr" Nov 04 02:10:51.728543 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:51.728512 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-4rjrr" Nov 04 02:10:52.162499 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:52.162464 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-4rjrr"] Nov 04 02:10:52.170320 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:10:52.166982 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb30b14a3_30a1_4c84_a429_caf63c0eb4ff.slice/crio-d1acf1280f2146ab0488fca15abff4cf720c0894a9330b2eca12d2f10e7355b8 WatchSource:0}: Error finding container d1acf1280f2146ab0488fca15abff4cf720c0894a9330b2eca12d2f10e7355b8: Status 404 returned error can't find the container with id d1acf1280f2146ab0488fca15abff4cf720c0894a9330b2eca12d2f10e7355b8 Nov 04 02:10:52.309344 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:52.309307 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-4rjrr" event={"ID":"b30b14a3-30a1-4c84-a429-caf63c0eb4ff","Type":"ContainerStarted","Data":"d1acf1280f2146ab0488fca15abff4cf720c0894a9330b2eca12d2f10e7355b8"} Nov 04 02:10:54.014135 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.014101 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dpq46"] Nov 04 02:10:54.020595 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.020568 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:10:54.020760 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.020739 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" Nov 04 02:10:54.023790 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.023768 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" Nov 04 02:10:54.032169 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.032148 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwgj7\" (UniqueName: \"kubernetes.io/projected/0691db3f-a8d0-4d2e-9ed6-85d601af8df9-kube-api-access-qwgj7\") pod \"authorino-56c6c9ddd5-dpq46\" (UID: \"0691db3f-a8d0-4d2e-9ed6-85d601af8df9\") " pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" Nov 04 02:10:54.074198 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.074077 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dpq46"] Nov 04 02:10:54.077709 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.077678 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:10:54.134506 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.134479 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwgj7\" (UniqueName: \"kubernetes.io/projected/0691db3f-a8d0-4d2e-9ed6-85d601af8df9-kube-api-access-qwgj7\") pod \"authorino-56c6c9ddd5-dpq46\" (UID: \"0691db3f-a8d0-4d2e-9ed6-85d601af8df9\") " pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" Nov 04 02:10:54.134574 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.134556 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/524477a3-c995-4ce2-b670-d336faf359e9-config-file\") pod \"limitador-limitador-7c9b87d574-6zzb8\" (UID: \"524477a3-c995-4ce2-b670-d336faf359e9\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" Nov 04 02:10:54.134632 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.134592 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjbzx\" (UniqueName: \"kubernetes.io/projected/524477a3-c995-4ce2-b670-d336faf359e9-kube-api-access-kjbzx\") pod \"limitador-limitador-7c9b87d574-6zzb8\" (UID: \"524477a3-c995-4ce2-b670-d336faf359e9\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" Nov 04 02:10:54.204166 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.204139 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwgj7\" (UniqueName: \"kubernetes.io/projected/0691db3f-a8d0-4d2e-9ed6-85d601af8df9-kube-api-access-qwgj7\") pod \"authorino-56c6c9ddd5-dpq46\" (UID: \"0691db3f-a8d0-4d2e-9ed6-85d601af8df9\") " pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" Nov 04 02:10:54.235448 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.235422 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/524477a3-c995-4ce2-b670-d336faf359e9-config-file\") pod \"limitador-limitador-7c9b87d574-6zzb8\" (UID: \"524477a3-c995-4ce2-b670-d336faf359e9\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" Nov 04 02:10:54.235585 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.235473 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjbzx\" (UniqueName: \"kubernetes.io/projected/524477a3-c995-4ce2-b670-d336faf359e9-kube-api-access-kjbzx\") pod \"limitador-limitador-7c9b87d574-6zzb8\" (UID: \"524477a3-c995-4ce2-b670-d336faf359e9\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" Nov 04 02:10:54.236067 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.236048 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/524477a3-c995-4ce2-b670-d336faf359e9-config-file\") pod \"limitador-limitador-7c9b87d574-6zzb8\" (UID: \"524477a3-c995-4ce2-b670-d336faf359e9\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" Nov 04 02:10:54.296980 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.296853 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjbzx\" (UniqueName: \"kubernetes.io/projected/524477a3-c995-4ce2-b670-d336faf359e9-kube-api-access-kjbzx\") pod \"limitador-limitador-7c9b87d574-6zzb8\" (UID: \"524477a3-c995-4ce2-b670-d336faf359e9\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" Nov 04 02:10:54.320309 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.320256 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" event={"ID":"72c0fcc2-6573-4707-b446-0976f7213131","Type":"ContainerStarted","Data":"59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722"} Nov 04 02:10:54.320516 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.320459 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:10:54.324314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.324265 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:10:54.336678 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.336650 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" Nov 04 02:10:54.345551 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.345534 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" Nov 04 02:10:54.438139 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.437623 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" podStartSLOduration=1.73259648 podStartE2EDuration="5.437604155s" totalImagesPullingTime="3.705007675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:10:54.436643168 +0000 UTC m=+199.925151868" watchObservedRunningTime="2026-11-04 02:10:54.437604155 +0000 UTC m=+199.926112857" Nov 04 02:10:54.724219 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.724184 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dpq46"] Nov 04 02:10:54.776681 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:54.776655 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:10:54.780036 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:10:54.780013 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524477a3_c995_4ce2_b670_d336faf359e9.slice/crio-40e478942177fbd5ddeec77538f49d4ebc7ee1046080d513b5eca58a6f4366d0 WatchSource:0}: Error finding container 40e478942177fbd5ddeec77538f49d4ebc7ee1046080d513b5eca58a6f4366d0: Status 404 returned error can't find the container with id 40e478942177fbd5ddeec77538f49d4ebc7ee1046080d513b5eca58a6f4366d0 Nov 04 02:10:55.326557 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:55.326516 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" event={"ID":"524477a3-c995-4ce2-b670-d336faf359e9","Type":"ContainerStarted","Data":"264393264dc111113d48aa5aa68941e6733408fb6164f161a98ae32832006e62"} Nov 04 02:10:55.327073 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:55.326582 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" event={"ID":"524477a3-c995-4ce2-b670-d336faf359e9","Type":"ContainerStarted","Data":"40e478942177fbd5ddeec77538f49d4ebc7ee1046080d513b5eca58a6f4366d0"} Nov 04 02:10:55.327073 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:55.326650 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" Nov 04 02:10:55.328280 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:55.328248 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" event={"ID":"0691db3f-a8d0-4d2e-9ed6-85d601af8df9","Type":"ContainerStarted","Data":"4e7aa09a17bbc989003150913caa75bef9a8485281af39174458f708d60ef9f9"} Nov 04 02:10:55.442063 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:55.442019 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" podStartSLOduration=2.442006079 podStartE2EDuration="2.442006079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:10:55.44174402 +0000 UTC m=+200.930252730" watchObservedRunningTime="2026-11-04 02:10:55.442006079 +0000 UTC m=+200.930514778" Nov 04 02:10:56.341087 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:56.340693 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" event={"ID":"0691db3f-a8d0-4d2e-9ed6-85d601af8df9","Type":"ContainerStarted","Data":"eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63"} Nov 04 02:10:56.342608 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:56.342574 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-4rjrr" event={"ID":"b30b14a3-30a1-4c84-a429-caf63c0eb4ff","Type":"ContainerStarted","Data":"040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200"} Nov 04 02:10:56.454892 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:56.454828 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" podStartSLOduration=2.166092839 podStartE2EDuration="3.454811979s" totalImagesPullingTime="1.28871914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:10:56.454732825 +0000 UTC m=+201.943241516" watchObservedRunningTime="2026-11-04 02:10:56.454811979 +0000 UTC m=+201.943320680" Nov 04 02:10:56.479711 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:56.479671 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-4rjrr"] Nov 04 02:10:56.568989 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:56.568912 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-4rjrr" podStartSLOduration=2.304643853 podStartE2EDuration="5.568894512s" totalImagesPullingTime="3.264250659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:10:56.567832177 +0000 UTC m=+202.056340878" watchObservedRunningTime="2026-11-04 02:10:56.568894512 +0000 UTC m=+202.057403211" Nov 04 02:10:58.351839 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:58.351786 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" event={"ID":"62d7cc3a-fd4e-4358-9184-43db843de40c","Type":"ContainerStarted","Data":"25e0638575e96a5eef34d939bfb2c1bf1f68b9c368ec9b20bf9a5fb6b4aed561"} Nov 04 02:10:58.352246 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:58.352033 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" Nov 04 02:10:58.352246 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:58.352031 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-4rjrr" podUID="b30b14a3-30a1-4c84-a429-caf63c0eb4ff" containerName="authorino" containerID="cri-o://040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200" gracePeriod=30 Nov 04 02:10:58.589597 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:58.589502 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" podStartSLOduration=1.89551617 podStartE2EDuration="21.589481481s" totalImagesPullingTime="19.693965311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:10:58.474685761 +0000 UTC m=+203.963194461" watchObservedRunningTime="2026-11-04 02:10:58.589481481 +0000 UTC m=+204.077990181" Nov 04 02:10:58.591701 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:58.591681 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-4rjrr" Nov 04 02:10:58.674011 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:58.673981 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b30b14a3-30a1-4c84-a429-caf63c0eb4ff-kube-api-access-n4njd\" (UniqueName: \"kubernetes.io/projected/b30b14a3-30a1-4c84-a429-caf63c0eb4ff-kube-api-access-n4njd\") pod \"b30b14a3-30a1-4c84-a429-caf63c0eb4ff\" (UID: \"b30b14a3-30a1-4c84-a429-caf63c0eb4ff\") " Nov 04 02:10:58.676321 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:58.676298 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b30b14a3-30a1-4c84-a429-caf63c0eb4ff-kube-api-access-n4njd" pod "b30b14a3-30a1-4c84-a429-caf63c0eb4ff" (UID: "b30b14a3-30a1-4c84-a429-caf63c0eb4ff"). InnerVolumeSpecName "kube-api-access-n4njd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:10:58.775081 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:58.775051 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4njd\" (UniqueName: \"kubernetes.io/projected/b30b14a3-30a1-4c84-a429-caf63c0eb4ff-kube-api-access-n4njd\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:10:59.356743 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:59.356707 5219 generic.go:356] "Generic (PLEG): container finished" podID="b30b14a3-30a1-4c84-a429-caf63c0eb4ff" containerID="040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200" exitCode=0 Nov 04 02:10:59.357222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:59.356754 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-4rjrr" Nov 04 02:10:59.357222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:59.356774 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-4rjrr" event={"ID":"b30b14a3-30a1-4c84-a429-caf63c0eb4ff","Type":"ContainerDied","Data":"040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200"} Nov 04 02:10:59.357222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:59.356821 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-4rjrr" event={"ID":"b30b14a3-30a1-4c84-a429-caf63c0eb4ff","Type":"ContainerDied","Data":"d1acf1280f2146ab0488fca15abff4cf720c0894a9330b2eca12d2f10e7355b8"} Nov 04 02:10:59.357222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:59.356845 5219 scope.go:122] "RemoveContainer" containerID="040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200" Nov 04 02:10:59.366028 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:59.366008 5219 scope.go:122] "RemoveContainer" containerID="040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200" Nov 04 02:10:59.366316 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:10:59.366272 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200\": container with ID starting with 040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200 not found: ID does not exist" containerID="040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200" Nov 04 02:10:59.366407 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:59.366326 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200"} err="failed to get container status \"040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200\": rpc error: code = NotFound desc = could not find container \"040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200\": container with ID starting with 040f1819669ec0e91ff6620ad39bbd5870876fdfa51bde7bdf489e72c65bf200 not found: ID does not exist" Nov 04 02:10:59.518765 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:59.518732 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-4rjrr"] Nov 04 02:10:59.568164 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:10:59.568131 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-4rjrr"] Nov 04 02:11:00.612741 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:00.612665 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b30b14a3-30a1-4c84-a429-caf63c0eb4ff" path="/var/lib/kubelet/pods/b30b14a3-30a1-4c84-a429-caf63c0eb4ff/volumes" Nov 04 02:11:02.589860 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.589829 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd"] Nov 04 02:11:02.590615 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.590601 5219 cpu_manager.go:414] "containerMap: removing container" podUID="b30b14a3-30a1-4c84-a429-caf63c0eb4ff" containerName="authorino" Nov 04 02:11:02.590664 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.590617 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b30b14a3-30a1-4c84-a429-caf63c0eb4ff" containerName="authorino" Nov 04 02:11:02.590697 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.590672 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="b30b14a3-30a1-4c84-a429-caf63c0eb4ff" containerName="authorino" Nov 04 02:11:02.594769 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.594754 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.646921 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.646896 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 04 02:11:02.646921 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.646896 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 04 02:11:02.706546 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.706518 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca136539-2665-46ab-8bef-62ba3a90c20e-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.706668 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.706561 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xpvd\" (UniqueName: \"kubernetes.io/projected/ca136539-2665-46ab-8bef-62ba3a90c20e-kube-api-access-7xpvd\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.706668 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.706585 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca136539-2665-46ab-8bef-62ba3a90c20e-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.706755 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.706681 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca136539-2665-46ab-8bef-62ba3a90c20e-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.795845 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.795816 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-jxfrm\"" Nov 04 02:11:02.795845 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.795830 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Nov 04 02:11:02.796793 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.796774 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd"] Nov 04 02:11:02.807263 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.807239 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca136539-2665-46ab-8bef-62ba3a90c20e-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.807407 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.807280 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca136539-2665-46ab-8bef-62ba3a90c20e-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.807407 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.807347 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xpvd\" (UniqueName: \"kubernetes.io/projected/ca136539-2665-46ab-8bef-62ba3a90c20e-kube-api-access-7xpvd\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.807407 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.807387 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca136539-2665-46ab-8bef-62ba3a90c20e-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.807774 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.807754 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca136539-2665-46ab-8bef-62ba3a90c20e-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.807844 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.807812 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca136539-2665-46ab-8bef-62ba3a90c20e-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.808266 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.808250 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca136539-2665-46ab-8bef-62ba3a90c20e-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.868252 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.868186 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xpvd\" (UniqueName: \"kubernetes.io/projected/ca136539-2665-46ab-8bef-62ba3a90c20e-kube-api-access-7xpvd\") pod \"kserve-module-controller-manager-7566cf5fc8-cwztd\" (UID: \"ca136539-2665-46ab-8bef-62ba3a90c20e\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:02.906790 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:02.906762 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:03.330498 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:03.330459 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd"] Nov 04 02:11:03.334561 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:11:03.334536 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca136539_2665_46ab_8bef_62ba3a90c20e.slice/crio-91cbe49541cc186f58a03090d947a2c5b192a0245a04b20e70541e07f4ccceaa WatchSource:0}: Error finding container 91cbe49541cc186f58a03090d947a2c5b192a0245a04b20e70541e07f4ccceaa: Status 404 returned error can't find the container with id 91cbe49541cc186f58a03090d947a2c5b192a0245a04b20e70541e07f4ccceaa Nov 04 02:11:03.372191 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:03.372157 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" event={"ID":"ca136539-2665-46ab-8bef-62ba3a90c20e","Type":"ContainerStarted","Data":"91cbe49541cc186f58a03090d947a2c5b192a0245a04b20e70541e07f4ccceaa"} Nov 04 02:11:04.358896 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:04.358863 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v6s46" Nov 04 02:11:05.329456 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:05.329422 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:11:06.343656 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:06.343626 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-6zzb8" Nov 04 02:11:06.386427 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:06.386388 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" event={"ID":"ca136539-2665-46ab-8bef-62ba3a90c20e","Type":"ContainerStarted","Data":"8a0815296ae399b609e7377bec9a3f900c2fc82be312939ebf5c5b652dd0e02c"} Nov 04 02:11:06.386610 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:06.386523 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:06.509990 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:06.509907 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wrxqt"] Nov 04 02:11:06.510231 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:06.510209 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" podUID="72c0fcc2-6573-4707-b446-0976f7213131" containerName="limitador" containerID="cri-o://59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722" gracePeriod=30 Nov 04 02:11:06.577678 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:06.577628 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" podStartSLOduration=1.734198268 podStartE2EDuration="4.577615299s" totalImagesPullingTime="2.843417031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:11:06.577437295 +0000 UTC m=+212.065945997" watchObservedRunningTime="2026-11-04 02:11:06.577615299 +0000 UTC m=+212.066123998" Nov 04 02:11:07.049595 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.049571 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:11:07.142231 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.142154 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72c0fcc2-6573-4707-b446-0976f7213131-kube-api-access-q47k8\" (UniqueName: \"kubernetes.io/projected/72c0fcc2-6573-4707-b446-0976f7213131-kube-api-access-q47k8\") pod \"72c0fcc2-6573-4707-b446-0976f7213131\" (UID: \"72c0fcc2-6573-4707-b446-0976f7213131\") " Nov 04 02:11:07.142411 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.142336 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72c0fcc2-6573-4707-b446-0976f7213131-config-file\" (UniqueName: \"kubernetes.io/configmap/72c0fcc2-6573-4707-b446-0976f7213131-config-file\") pod \"72c0fcc2-6573-4707-b446-0976f7213131\" (UID: \"72c0fcc2-6573-4707-b446-0976f7213131\") " Nov 04 02:11:07.142605 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.142583 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72c0fcc2-6573-4707-b446-0976f7213131-config-file" pod "72c0fcc2-6573-4707-b446-0976f7213131" (UID: "72c0fcc2-6573-4707-b446-0976f7213131"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:11:07.144344 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.144319 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c0fcc2-6573-4707-b446-0976f7213131-kube-api-access-q47k8" pod "72c0fcc2-6573-4707-b446-0976f7213131" (UID: "72c0fcc2-6573-4707-b446-0976f7213131"). InnerVolumeSpecName "kube-api-access-q47k8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:11:07.243581 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.243544 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q47k8\" (UniqueName: \"kubernetes.io/projected/72c0fcc2-6573-4707-b446-0976f7213131-kube-api-access-q47k8\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:11:07.243581 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.243575 5219 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72c0fcc2-6573-4707-b446-0976f7213131-config-file\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:11:07.391492 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.391456 5219 generic.go:356] "Generic (PLEG): container finished" podID="72c0fcc2-6573-4707-b446-0976f7213131" containerID="59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722" exitCode=0 Nov 04 02:11:07.391954 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.391505 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" Nov 04 02:11:07.391954 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.391544 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" event={"ID":"72c0fcc2-6573-4707-b446-0976f7213131","Type":"ContainerDied","Data":"59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722"} Nov 04 02:11:07.391954 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.391596 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-wrxqt" event={"ID":"72c0fcc2-6573-4707-b446-0976f7213131","Type":"ContainerDied","Data":"9317b41c10b17d54c7232f339585aeab011768093878eaca3e79689a9fa7ed0e"} Nov 04 02:11:07.391954 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.391625 5219 scope.go:122] "RemoveContainer" containerID="59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722" Nov 04 02:11:07.399582 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.399568 5219 scope.go:122] "RemoveContainer" containerID="59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722" Nov 04 02:11:07.399826 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:11:07.399809 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722\": container with ID starting with 59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722 not found: ID does not exist" containerID="59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722" Nov 04 02:11:07.399886 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.399834 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722"} err="failed to get container status \"59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722\": rpc error: code = NotFound desc = could not find container \"59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722\": container with ID starting with 59f7647fabc7e60f34be250062ef6ef0580d59636a3db6a01cc1488bf3069722 not found: ID does not exist" Nov 04 02:11:07.553669 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.553631 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wrxqt"] Nov 04 02:11:07.603152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:07.603115 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wrxqt"] Nov 04 02:11:08.612665 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:08.612632 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72c0fcc2-6573-4707-b446-0976f7213131" path="/var/lib/kubelet/pods/72c0fcc2-6573-4707-b446-0976f7213131/volumes" Nov 04 02:11:08.929199 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:11:08.929169 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:11:10.926406 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:10.926379 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9"] Nov 04 02:11:10.926785 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:10.926652 5219 cpu_manager.go:414] "containerMap: removing container" podUID="72c0fcc2-6573-4707-b446-0976f7213131" containerName="limitador" Nov 04 02:11:10.926785 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:10.926661 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72c0fcc2-6573-4707-b446-0976f7213131" containerName="limitador" Nov 04 02:11:10.926785 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:10.926715 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="72c0fcc2-6573-4707-b446-0976f7213131" containerName="limitador" Nov 04 02:11:10.930679 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:10.930660 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" Nov 04 02:11:10.983306 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:10.983253 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Nov 04 02:11:10.986678 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:10.986644 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 04 02:11:10.987366 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:10.987341 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9"] Nov 04 02:11:11.032459 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:11.032431 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 04 02:11:11.073429 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:11.073396 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7snkb\" (UniqueName: \"kubernetes.io/projected/4ede875e-3c40-48d2-a122-fc8fadfdd6c2-kube-api-access-7snkb\") pod \"postgres-7cdbf6dc44-4ctr9\" (UID: \"4ede875e-3c40-48d2-a122-fc8fadfdd6c2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" Nov 04 02:11:11.073573 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:11.073434 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4ede875e-3c40-48d2-a122-fc8fadfdd6c2-data\") pod \"postgres-7cdbf6dc44-4ctr9\" (UID: \"4ede875e-3c40-48d2-a122-fc8fadfdd6c2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" Nov 04 02:11:11.083872 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:11.083854 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2hmb9\"" Nov 04 02:11:11.174325 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:11.174271 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7snkb\" (UniqueName: \"kubernetes.io/projected/4ede875e-3c40-48d2-a122-fc8fadfdd6c2-kube-api-access-7snkb\") pod \"postgres-7cdbf6dc44-4ctr9\" (UID: \"4ede875e-3c40-48d2-a122-fc8fadfdd6c2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" Nov 04 02:11:11.174458 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:11.174328 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4ede875e-3c40-48d2-a122-fc8fadfdd6c2-data\") pod \"postgres-7cdbf6dc44-4ctr9\" (UID: \"4ede875e-3c40-48d2-a122-fc8fadfdd6c2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" Nov 04 02:11:11.174683 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:11.174667 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4ede875e-3c40-48d2-a122-fc8fadfdd6c2-data\") pod \"postgres-7cdbf6dc44-4ctr9\" (UID: \"4ede875e-3c40-48d2-a122-fc8fadfdd6c2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" Nov 04 02:11:11.234739 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:11.234672 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7snkb\" (UniqueName: \"kubernetes.io/projected/4ede875e-3c40-48d2-a122-fc8fadfdd6c2-kube-api-access-7snkb\") pod \"postgres-7cdbf6dc44-4ctr9\" (UID: \"4ede875e-3c40-48d2-a122-fc8fadfdd6c2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" Nov 04 02:11:11.242460 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:11.242439 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" Nov 04 02:11:11.613602 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:11.613529 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9"] Nov 04 02:11:11.617312 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:11:11.617260 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ede875e_3c40_48d2_a122_fc8fadfdd6c2.slice/crio-1e65826e37cceba51a05f5228e3a3bc4e0b781306f44c860fb3691dd5ad25cb2 WatchSource:0}: Error finding container 1e65826e37cceba51a05f5228e3a3bc4e0b781306f44c860fb3691dd5ad25cb2: Status 404 returned error can't find the container with id 1e65826e37cceba51a05f5228e3a3bc4e0b781306f44c860fb3691dd5ad25cb2 Nov 04 02:11:12.412359 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:12.412321 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" event={"ID":"4ede875e-3c40-48d2-a122-fc8fadfdd6c2","Type":"ContainerStarted","Data":"1e65826e37cceba51a05f5228e3a3bc4e0b781306f44c860fb3691dd5ad25cb2"} Nov 04 02:11:21.449226 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:21.449192 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" event={"ID":"4ede875e-3c40-48d2-a122-fc8fadfdd6c2","Type":"ContainerStarted","Data":"3c304bc73720b54fc710dc27c6deed476b3afe4fc57883cddd8ea514cc6271a7"} Nov 04 02:11:21.449682 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:21.449323 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" Nov 04 02:11:21.564234 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:21.564179 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" podStartSLOduration=2.59620765 podStartE2EDuration="11.564163498s" totalImagesPullingTime="8.967955848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:11:21.563461909 +0000 UTC m=+227.051970634" watchObservedRunningTime="2026-11-04 02:11:21.564163498 +0000 UTC m=+227.052672197" Nov 04 02:11:27.393602 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:27.393572 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-cwztd" Nov 04 02:11:27.482125 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:11:27.482097 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9" Nov 04 02:11:38.932549 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:11:38.932507 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:12:03.314029 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.314000 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682"] Nov 04 02:12:03.320992 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.320970 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.371639 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.371612 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.371761 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.371643 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.371761 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.371660 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.371761 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.371714 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.371761 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.371736 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.371920 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.371827 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6rw\" (UniqueName: \"kubernetes.io/projected/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-kube-api-access-cp6rw\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.371920 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.371855 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.421847 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.421822 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682"] Nov 04 02:12:03.472505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.472480 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6rw\" (UniqueName: \"kubernetes.io/projected/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-kube-api-access-cp6rw\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.472607 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.472509 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.472607 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.472527 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.472607 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.472545 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.472732 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.472653 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.472785 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.472726 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.472785 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.472760 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.473707 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.473680 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.475113 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.475089 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.475215 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.475131 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.475215 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.475202 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.475345 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.475230 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.533038 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.533005 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.533181 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.533164 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6rw\" (UniqueName: \"kubernetes.io/projected/30ddd80a-29fb-4f92-9fc4-ee58b9b057d4-kube-api-access-cp6rw\") pod \"istiod-openshift-gateway-7ddd9cfdc8-vr682\" (UID: \"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:03.632268 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:03.632215 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:04.057975 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:04.057948 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682"] Nov 04 02:12:04.061350 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:12:04.061322 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ddd80a_29fb_4f92_9fc4_ee58b9b057d4.slice/crio-6ae0f43d9c6d5d836b3526e21958d95aadcd7df1dc2bbe9ae1273efe542566e5 WatchSource:0}: Error finding container 6ae0f43d9c6d5d836b3526e21958d95aadcd7df1dc2bbe9ae1273efe542566e5: Status 404 returned error can't find the container with id 6ae0f43d9c6d5d836b3526e21958d95aadcd7df1dc2bbe9ae1273efe542566e5 Nov 04 02:12:04.063385 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:04.063352 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:12:04.063453 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:04.063414 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:12:04.606908 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:04.606872 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" event={"ID":"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4","Type":"ContainerStarted","Data":"eef75f86287d0e9c378f42e5c4e9a28f775ec4891cdf5533c04a04841b0211d6"} Nov 04 02:12:04.607330 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:04.606923 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" event={"ID":"30ddd80a-29fb-4f92-9fc4-ee58b9b057d4","Type":"ContainerStarted","Data":"6ae0f43d9c6d5d836b3526e21958d95aadcd7df1dc2bbe9ae1273efe542566e5"} Nov 04 02:12:04.607330 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:04.607009 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:04.777079 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:04.777030 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" podStartSLOduration=1.7770190019999998 podStartE2EDuration="1.777019002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:12:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:12:04.727211237 +0000 UTC m=+270.215719958" watchObservedRunningTime="2026-11-04 02:12:04.777019002 +0000 UTC m=+270.265527702" Nov 04 02:12:05.612388 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:05.612358 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vr682" Nov 04 02:12:05.837476 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:05.837444 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh"] Nov 04 02:12:05.837671 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:05.837650 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" podUID="7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" containerName="discovery" containerID="cri-o://b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f" gracePeriod=30 Nov 04 02:12:06.081550 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.081522 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:12:06.196715 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.196649 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-kube-api-access-zpzqm\" (UniqueName: \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-kube-api-access-zpzqm\") pod \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " Nov 04 02:12:06.196715 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.196680 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-local-certs\") pod \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " Nov 04 02:12:06.196929 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.196719 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-cacerts\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-cacerts\") pod \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " Nov 04 02:12:06.196929 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.196743 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-token\" (UniqueName: \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-token\") pod \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " Nov 04 02:12:06.196929 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.196764 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-kubeconfig\") pod \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " Nov 04 02:12:06.196929 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.196799 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-ca-configmap\") pod \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " Nov 04 02:12:06.196929 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.196833 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-dns-cert\") pod \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\" (UID: \"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe\") " Nov 04 02:12:06.197329 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.197268 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-ca-configmap" pod "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" (UID: "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:12:06.199276 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.199243 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-kubeconfig" pod "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" (UID: "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:12:06.199452 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.199356 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-dns-cert" pod "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" (UID: "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:12:06.199604 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.199579 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-local-certs" pod "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" (UID: "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:12:06.199809 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.199626 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-token" pod "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" (UID: "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:12:06.199809 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.199686 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-cacerts" pod "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" (UID: "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:12:06.199809 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.199718 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-kube-api-access-zpzqm" pod "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" (UID: "7e935cc0-d6c3-4ed6-89be-dc97e9deedfe"). InnerVolumeSpecName "kube-api-access-zpzqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:12:06.297926 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.297900 5219 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-cacerts\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:12:06.297926 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.297921 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:12:06.297926 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.297931 5219 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-kubeconfig\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:12:06.298096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.297941 5219 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-ca-configmap\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:12:06.298096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.297951 5219 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-istio-csr-dns-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:12:06.298096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.297960 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpzqm\" (UniqueName: \"kubernetes.io/projected/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-kube-api-access-zpzqm\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:12:06.298096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.297968 5219 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe-local-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:12:06.615316 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.615217 5219 generic.go:356] "Generic (PLEG): container finished" podID="7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" containerID="b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f" exitCode=0 Nov 04 02:12:06.615316 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.615262 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" Nov 04 02:12:06.615818 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.615324 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" event={"ID":"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe","Type":"ContainerDied","Data":"b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f"} Nov 04 02:12:06.615818 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.615375 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" event={"ID":"7e935cc0-d6c3-4ed6-89be-dc97e9deedfe","Type":"ContainerDied","Data":"1d659bdeff6bb3880107a2f21f0f6f0c15ff6feb17f9fffd3f7f05928633bb01"} Nov 04 02:12:06.615818 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.615409 5219 scope.go:122] "RemoveContainer" containerID="b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f" Nov 04 02:12:06.624656 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.624641 5219 scope.go:122] "RemoveContainer" containerID="b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f" Nov 04 02:12:06.624891 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:12:06.624867 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f\": container with ID starting with b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f not found: ID does not exist" containerID="b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f" Nov 04 02:12:06.624983 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.624894 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f"} err="failed to get container status \"b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f\": rpc error: code = NotFound desc = could not find container \"b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f\": container with ID starting with b9edcf7b7af56d1ad9c78549011c4fd5452462947711b91984b0d8040957258f not found: ID does not exist" Nov 04 02:12:06.777953 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.777924 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh"] Nov 04 02:12:06.827420 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:06.827391 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh"] Nov 04 02:12:08.613433 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:08.613401 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" path="/var/lib/kubelet/pods/7e935cc0-d6c3-4ed6-89be-dc97e9deedfe/volumes" Nov 04 02:12:08.929071 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:12:08.929039 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:12:09.138938 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.138904 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr"] Nov 04 02:12:09.139186 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.139175 5219 cpu_manager.go:414] "containerMap: removing container" podUID="7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" containerName="discovery" Nov 04 02:12:09.139233 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.139187 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" containerName="discovery" Nov 04 02:12:09.139263 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.139247 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" containerName="discovery" Nov 04 02:12:09.143394 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.143375 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:12:09.220456 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.220376 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/523bc755-695f-47e4-b5de-1192fdf371b0-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-dwnhr\" (UID: \"523bc755-695f-47e4-b5de-1192fdf371b0\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:12:09.220456 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.220408 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnsnq\" (UniqueName: \"kubernetes.io/projected/523bc755-695f-47e4-b5de-1192fdf371b0-kube-api-access-nnsnq\") pod \"llmisvc-controller-manager-869d5dcc5d-dwnhr\" (UID: \"523bc755-695f-47e4-b5de-1192fdf371b0\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:12:09.244881 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.244851 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9gn2v\"" Nov 04 02:12:09.244881 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.244853 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Nov 04 02:12:09.245766 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.245746 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr"] Nov 04 02:12:09.321866 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.321839 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/523bc755-695f-47e4-b5de-1192fdf371b0-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-dwnhr\" (UID: \"523bc755-695f-47e4-b5de-1192fdf371b0\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:12:09.321866 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.321870 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnsnq\" (UniqueName: \"kubernetes.io/projected/523bc755-695f-47e4-b5de-1192fdf371b0-kube-api-access-nnsnq\") pod \"llmisvc-controller-manager-869d5dcc5d-dwnhr\" (UID: \"523bc755-695f-47e4-b5de-1192fdf371b0\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:12:09.324699 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.324678 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/523bc755-695f-47e4-b5de-1192fdf371b0-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-dwnhr\" (UID: \"523bc755-695f-47e4-b5de-1192fdf371b0\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:12:09.384432 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.384401 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnsnq\" (UniqueName: \"kubernetes.io/projected/523bc755-695f-47e4-b5de-1192fdf371b0-kube-api-access-nnsnq\") pod \"llmisvc-controller-manager-869d5dcc5d-dwnhr\" (UID: \"523bc755-695f-47e4-b5de-1192fdf371b0\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:12:09.460459 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.460427 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:12:09.830265 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:09.830189 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr"] Nov 04 02:12:09.834203 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:12:09.834169 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod523bc755_695f_47e4_b5de_1192fdf371b0.slice/crio-619e60f191cf843908b23e85185df74f8c4e192e56c815c636f288ba9a31e906 WatchSource:0}: Error finding container 619e60f191cf843908b23e85185df74f8c4e192e56c815c636f288ba9a31e906: Status 404 returned error can't find the container with id 619e60f191cf843908b23e85185df74f8c4e192e56c815c636f288ba9a31e906 Nov 04 02:12:10.632035 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:10.632004 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" event={"ID":"523bc755-695f-47e4-b5de-1192fdf371b0","Type":"ContainerStarted","Data":"619e60f191cf843908b23e85185df74f8c4e192e56c815c636f288ba9a31e906"} Nov 04 02:12:11.021319 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:11.021269 5219 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-mk6kh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.11:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 02:12:11.021712 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:11.021347 5219 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mk6kh" podUID="7e935cc0-d6c3-4ed6-89be-dc97e9deedfe" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.11:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 02:12:13.645332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:13.645270 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" event={"ID":"523bc755-695f-47e4-b5de-1192fdf371b0","Type":"ContainerStarted","Data":"96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a"} Nov 04 02:12:13.645740 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:13.645373 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:12:13.766703 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:13.766651 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" podStartSLOduration=1.6960018190000001 podStartE2EDuration="4.766638556s" totalImagesPullingTime="3.070636737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:12:13.766476493 +0000 UTC m=+279.254985195" watchObservedRunningTime="2026-11-04 02:12:13.766638556 +0000 UTC m=+279.255147252" Nov 04 02:12:21.748205 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:21.748168 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:12:31.154779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.154741 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xp25w"] Nov 04 02:12:31.157033 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.157015 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-xp25w" Nov 04 02:12:31.212432 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.212400 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xp25w"] Nov 04 02:12:31.304636 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.304596 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp9dl\" (UniqueName: \"kubernetes.io/projected/cde57d10-3ac2-493f-8878-9017f25a7dae-kube-api-access-tp9dl\") pod \"authorino-6f6944bcdd-xp25w\" (UID: \"cde57d10-3ac2-493f-8878-9017f25a7dae\") " pod="kuadrant-system/authorino-6f6944bcdd-xp25w" Nov 04 02:12:31.406067 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.405979 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp9dl\" (UniqueName: \"kubernetes.io/projected/cde57d10-3ac2-493f-8878-9017f25a7dae-kube-api-access-tp9dl\") pod \"authorino-6f6944bcdd-xp25w\" (UID: \"cde57d10-3ac2-493f-8878-9017f25a7dae\") " pod="kuadrant-system/authorino-6f6944bcdd-xp25w" Nov 04 02:12:31.466747 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.466720 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp9dl\" (UniqueName: \"kubernetes.io/projected/cde57d10-3ac2-493f-8878-9017f25a7dae-kube-api-access-tp9dl\") pod \"authorino-6f6944bcdd-xp25w\" (UID: \"cde57d10-3ac2-493f-8878-9017f25a7dae\") " pod="kuadrant-system/authorino-6f6944bcdd-xp25w" Nov 04 02:12:31.559004 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.558968 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xp25w"] Nov 04 02:12:31.559172 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.559145 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-xp25w" Nov 04 02:12:31.585602 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.585563 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-545dcc9b6-svq48"] Nov 04 02:12:31.587611 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.587586 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-545dcc9b6-svq48" Nov 04 02:12:31.645222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.645191 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-545dcc9b6-svq48"] Nov 04 02:12:31.709144 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.709098 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjsjg\" (UniqueName: \"kubernetes.io/projected/cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b-kube-api-access-sjsjg\") pod \"authorino-545dcc9b6-svq48\" (UID: \"cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b\") " pod="kuadrant-system/authorino-545dcc9b6-svq48" Nov 04 02:12:31.809974 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.809942 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjsjg\" (UniqueName: \"kubernetes.io/projected/cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b-kube-api-access-sjsjg\") pod \"authorino-545dcc9b6-svq48\" (UID: \"cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b\") " pod="kuadrant-system/authorino-545dcc9b6-svq48" Nov 04 02:12:31.871019 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.870986 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjsjg\" (UniqueName: \"kubernetes.io/projected/cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b-kube-api-access-sjsjg\") pod \"authorino-545dcc9b6-svq48\" (UID: \"cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b\") " pod="kuadrant-system/authorino-545dcc9b6-svq48" Nov 04 02:12:31.898688 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.898650 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-545dcc9b6-svq48" Nov 04 02:12:31.926878 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.926844 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xp25w"] Nov 04 02:12:31.930243 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:12:31.930214 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcde57d10_3ac2_493f_8878_9017f25a7dae.slice/crio-a8b0e2cabf5048d584a73deaedf25230d9e84e5fc718c1a970705f980d6f0d5e WatchSource:0}: Error finding container a8b0e2cabf5048d584a73deaedf25230d9e84e5fc718c1a970705f980d6f0d5e: Status 404 returned error can't find the container with id a8b0e2cabf5048d584a73deaedf25230d9e84e5fc718c1a970705f980d6f0d5e Nov 04 02:12:31.981379 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:31.981260 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-545dcc9b6-svq48"] Nov 04 02:12:32.008463 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.008432 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58f5844cb4-pm56f"] Nov 04 02:12:32.012642 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.012559 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f5844cb4-pm56f" Nov 04 02:12:32.067450 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.067409 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Nov 04 02:12:32.068377 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.068350 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f5844cb4-pm56f"] Nov 04 02:12:32.112245 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.112210 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-tls-cert\") pod \"authorino-58f5844cb4-pm56f\" (UID: \"0ca7556c-8563-4e4f-a0d2-b47b94d471b8\") " pod="kuadrant-system/authorino-58f5844cb4-pm56f" Nov 04 02:12:32.112434 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.112258 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrcbk\" (UniqueName: \"kubernetes.io/projected/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-kube-api-access-lrcbk\") pod \"authorino-58f5844cb4-pm56f\" (UID: \"0ca7556c-8563-4e4f-a0d2-b47b94d471b8\") " pod="kuadrant-system/authorino-58f5844cb4-pm56f" Nov 04 02:12:32.213015 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.212974 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-tls-cert\") pod \"authorino-58f5844cb4-pm56f\" (UID: \"0ca7556c-8563-4e4f-a0d2-b47b94d471b8\") " pod="kuadrant-system/authorino-58f5844cb4-pm56f" Nov 04 02:12:32.213015 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.213017 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrcbk\" (UniqueName: \"kubernetes.io/projected/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-kube-api-access-lrcbk\") pod \"authorino-58f5844cb4-pm56f\" (UID: \"0ca7556c-8563-4e4f-a0d2-b47b94d471b8\") " pod="kuadrant-system/authorino-58f5844cb4-pm56f" Nov 04 02:12:32.215716 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.215692 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-tls-cert\") pod \"authorino-58f5844cb4-pm56f\" (UID: \"0ca7556c-8563-4e4f-a0d2-b47b94d471b8\") " pod="kuadrant-system/authorino-58f5844cb4-pm56f" Nov 04 02:12:32.267270 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.267172 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-545dcc9b6-svq48"] Nov 04 02:12:32.271236 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:12:32.271208 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd8abfa4_7692_4fa5_8dd9_5cd60a0b683b.slice/crio-fae5ea1744b66fb026b00f61fed57b0f2fb55173066595c370493d24e1dfeb21 WatchSource:0}: Error finding container fae5ea1744b66fb026b00f61fed57b0f2fb55173066595c370493d24e1dfeb21: Status 404 returned error can't find the container with id fae5ea1744b66fb026b00f61fed57b0f2fb55173066595c370493d24e1dfeb21 Nov 04 02:12:32.274727 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.274704 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrcbk\" (UniqueName: \"kubernetes.io/projected/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-kube-api-access-lrcbk\") pod \"authorino-58f5844cb4-pm56f\" (UID: \"0ca7556c-8563-4e4f-a0d2-b47b94d471b8\") " pod="kuadrant-system/authorino-58f5844cb4-pm56f" Nov 04 02:12:32.324277 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.324243 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f5844cb4-pm56f" Nov 04 02:12:32.691368 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.691337 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f5844cb4-pm56f"] Nov 04 02:12:32.695555 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:12:32.695527 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ca7556c_8563_4e4f_a0d2_b47b94d471b8.slice/crio-8f07c707d9f5870f382a0cb9273c81daed36756bb47b83d35a6f6092034dcf7c WatchSource:0}: Error finding container 8f07c707d9f5870f382a0cb9273c81daed36756bb47b83d35a6f6092034dcf7c: Status 404 returned error can't find the container with id 8f07c707d9f5870f382a0cb9273c81daed36756bb47b83d35a6f6092034dcf7c Nov 04 02:12:32.723737 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.723695 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-xp25w" event={"ID":"cde57d10-3ac2-493f-8878-9017f25a7dae","Type":"ContainerStarted","Data":"a8b0e2cabf5048d584a73deaedf25230d9e84e5fc718c1a970705f980d6f0d5e"} Nov 04 02:12:32.724820 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.724791 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f5844cb4-pm56f" event={"ID":"0ca7556c-8563-4e4f-a0d2-b47b94d471b8","Type":"ContainerStarted","Data":"8f07c707d9f5870f382a0cb9273c81daed36756bb47b83d35a6f6092034dcf7c"} Nov 04 02:12:32.725947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:32.725917 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-545dcc9b6-svq48" event={"ID":"cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b","Type":"ContainerStarted","Data":"fae5ea1744b66fb026b00f61fed57b0f2fb55173066595c370493d24e1dfeb21"} Nov 04 02:12:33.731768 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:33.731687 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-xp25w" event={"ID":"cde57d10-3ac2-493f-8878-9017f25a7dae","Type":"ContainerStarted","Data":"fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab"} Nov 04 02:12:33.731768 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:33.731751 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-xp25w" podUID="cde57d10-3ac2-493f-8878-9017f25a7dae" containerName="authorino" containerID="cri-o://fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab" gracePeriod=30 Nov 04 02:12:33.845281 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:33.845225 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-xp25w" podStartSLOduration=1.29672788 podStartE2EDuration="2.845209296s" totalImagesPullingTime="1.548481416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:12:33.844157599 +0000 UTC m=+299.332666303" watchObservedRunningTime="2026-11-04 02:12:33.845209296 +0000 UTC m=+299.333718016" Nov 04 02:12:33.974676 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:33.974651 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-xp25w" Nov 04 02:12:34.128229 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.128147 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cde57d10-3ac2-493f-8878-9017f25a7dae-kube-api-access-tp9dl\" (UniqueName: \"kubernetes.io/projected/cde57d10-3ac2-493f-8878-9017f25a7dae-kube-api-access-tp9dl\") pod \"cde57d10-3ac2-493f-8878-9017f25a7dae\" (UID: \"cde57d10-3ac2-493f-8878-9017f25a7dae\") " Nov 04 02:12:34.130295 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.130262 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde57d10-3ac2-493f-8878-9017f25a7dae-kube-api-access-tp9dl" pod "cde57d10-3ac2-493f-8878-9017f25a7dae" (UID: "cde57d10-3ac2-493f-8878-9017f25a7dae"). InnerVolumeSpecName "kube-api-access-tp9dl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:12:34.229120 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.229084 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp9dl\" (UniqueName: \"kubernetes.io/projected/cde57d10-3ac2-493f-8878-9017f25a7dae-kube-api-access-tp9dl\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:12:34.666354 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.666327 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:12:34.669108 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.668516 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:12:34.739254 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.739207 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f5844cb4-pm56f" event={"ID":"0ca7556c-8563-4e4f-a0d2-b47b94d471b8","Type":"ContainerStarted","Data":"1b51f23d9e1c1261434d4900fc92e35e4fd240397fe8b93f62e59b1f6ff8b5ac"} Nov 04 02:12:34.741177 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.741146 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-545dcc9b6-svq48" event={"ID":"cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b","Type":"ContainerStarted","Data":"3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a"} Nov 04 02:12:34.741370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.741173 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-545dcc9b6-svq48" podUID="cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b" containerName="authorino" containerID="cri-o://3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a" gracePeriod=30 Nov 04 02:12:34.743089 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.743059 5219 generic.go:356] "Generic (PLEG): container finished" podID="cde57d10-3ac2-493f-8878-9017f25a7dae" containerID="fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab" exitCode=0 Nov 04 02:12:34.743206 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.743100 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-xp25w" Nov 04 02:12:34.743206 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.743120 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-xp25w" event={"ID":"cde57d10-3ac2-493f-8878-9017f25a7dae","Type":"ContainerDied","Data":"fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab"} Nov 04 02:12:34.743206 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.743186 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-xp25w" event={"ID":"cde57d10-3ac2-493f-8878-9017f25a7dae","Type":"ContainerDied","Data":"a8b0e2cabf5048d584a73deaedf25230d9e84e5fc718c1a970705f980d6f0d5e"} Nov 04 02:12:34.743406 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.743215 5219 scope.go:122] "RemoveContainer" containerID="fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab" Nov 04 02:12:34.816358 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.816328 5219 scope.go:122] "RemoveContainer" containerID="fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab" Nov 04 02:12:34.816746 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:12:34.816724 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab\": container with ID starting with fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab not found: ID does not exist" containerID="fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab" Nov 04 02:12:34.816847 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.816758 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab"} err="failed to get container status \"fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab\": rpc error: code = NotFound desc = could not find container \"fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab\": container with ID starting with fa28cbb4ff51a35a749f5ffd9db4f9af94400af8e025fe4dd21cc7539ee860ab not found: ID does not exist" Nov 04 02:12:34.883655 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.878212 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-58f5844cb4-pm56f" podStartSLOduration=2.682149211 podStartE2EDuration="3.878192483s" totalImagesPullingTime="1.196043272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:12:34.855457804 +0000 UTC m=+300.343966505" watchObservedRunningTime="2026-11-04 02:12:34.878192483 +0000 UTC m=+300.366701184" Nov 04 02:12:34.883655 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.878494 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dpq46"] Nov 04 02:12:34.883655 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.878673 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" podUID="0691db3f-a8d0-4d2e-9ed6-85d601af8df9" containerName="authorino" containerID="cri-o://eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63" gracePeriod=30 Nov 04 02:12:34.970203 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:34.970144 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-545dcc9b6-svq48" podStartSLOduration=2.472851376 podStartE2EDuration="3.970128555s" totalImagesPullingTime="1.497277179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:12:34.969527454 +0000 UTC m=+300.458036185" watchObservedRunningTime="2026-11-04 02:12:34.970128555 +0000 UTC m=+300.458637256" Nov 04 02:12:35.022114 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.021547 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-545dcc9b6-svq48" Nov 04 02:12:35.079176 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.079136 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xp25w"] Nov 04 02:12:35.083834 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.083805 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xp25w"] Nov 04 02:12:35.118755 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.118734 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" Nov 04 02:12:35.135484 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.135455 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b-kube-api-access-sjsjg\" (UniqueName: \"kubernetes.io/projected/cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b-kube-api-access-sjsjg\") pod \"cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b\" (UID: \"cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b\") " Nov 04 02:12:35.137524 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.137500 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b-kube-api-access-sjsjg" pod "cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b" (UID: "cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b"). InnerVolumeSpecName "kube-api-access-sjsjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:12:35.236376 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.236329 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0691db3f-a8d0-4d2e-9ed6-85d601af8df9-kube-api-access-qwgj7\" (UniqueName: \"kubernetes.io/projected/0691db3f-a8d0-4d2e-9ed6-85d601af8df9-kube-api-access-qwgj7\") pod \"0691db3f-a8d0-4d2e-9ed6-85d601af8df9\" (UID: \"0691db3f-a8d0-4d2e-9ed6-85d601af8df9\") " Nov 04 02:12:35.236554 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.236543 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjsjg\" (UniqueName: \"kubernetes.io/projected/cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b-kube-api-access-sjsjg\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:12:35.238546 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.238518 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0691db3f-a8d0-4d2e-9ed6-85d601af8df9-kube-api-access-qwgj7" pod "0691db3f-a8d0-4d2e-9ed6-85d601af8df9" (UID: "0691db3f-a8d0-4d2e-9ed6-85d601af8df9"). InnerVolumeSpecName "kube-api-access-qwgj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:12:35.337134 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.337037 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwgj7\" (UniqueName: \"kubernetes.io/projected/0691db3f-a8d0-4d2e-9ed6-85d601af8df9-kube-api-access-qwgj7\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:12:35.748269 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.748241 5219 generic.go:356] "Generic (PLEG): container finished" podID="0691db3f-a8d0-4d2e-9ed6-85d601af8df9" containerID="eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63" exitCode=0 Nov 04 02:12:35.748751 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.748305 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" Nov 04 02:12:35.748751 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.748334 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" event={"ID":"0691db3f-a8d0-4d2e-9ed6-85d601af8df9","Type":"ContainerDied","Data":"eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63"} Nov 04 02:12:35.748751 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.748383 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dpq46" event={"ID":"0691db3f-a8d0-4d2e-9ed6-85d601af8df9","Type":"ContainerDied","Data":"4e7aa09a17bbc989003150913caa75bef9a8485281af39174458f708d60ef9f9"} Nov 04 02:12:35.748751 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.748401 5219 scope.go:122] "RemoveContainer" containerID="eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63" Nov 04 02:12:35.749727 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.749619 5219 generic.go:356] "Generic (PLEG): container finished" podID="cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b" containerID="3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a" exitCode=0 Nov 04 02:12:35.749727 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.749655 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-545dcc9b6-svq48" Nov 04 02:12:35.749727 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.749694 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-545dcc9b6-svq48" event={"ID":"cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b","Type":"ContainerDied","Data":"3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a"} Nov 04 02:12:35.749903 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.749744 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-545dcc9b6-svq48" event={"ID":"cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b","Type":"ContainerDied","Data":"fae5ea1744b66fb026b00f61fed57b0f2fb55173066595c370493d24e1dfeb21"} Nov 04 02:12:35.756532 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.756514 5219 scope.go:122] "RemoveContainer" containerID="eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63" Nov 04 02:12:35.756789 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:12:35.756771 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63\": container with ID starting with eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63 not found: ID does not exist" containerID="eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63" Nov 04 02:12:35.756836 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.756799 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63"} err="failed to get container status \"eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63\": rpc error: code = NotFound desc = could not find container \"eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63\": container with ID starting with eb632b857624872d35f57f13905702dee730307118072f1874cd5d46c2d3bc63 not found: ID does not exist" Nov 04 02:12:35.756836 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.756816 5219 scope.go:122] "RemoveContainer" containerID="3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a" Nov 04 02:12:35.764651 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.764624 5219 scope.go:122] "RemoveContainer" containerID="3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a" Nov 04 02:12:35.764907 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:12:35.764887 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a\": container with ID starting with 3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a not found: ID does not exist" containerID="3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a" Nov 04 02:12:35.764974 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.764917 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a"} err="failed to get container status \"3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a\": rpc error: code = NotFound desc = could not find container \"3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a\": container with ID starting with 3ba4a3c7fd691e38c5326de5e22ea9812f5f2a3e9a30ce70832a8d2aa1b1611a not found: ID does not exist" Nov 04 02:12:35.909826 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.909794 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-545dcc9b6-svq48"] Nov 04 02:12:35.915924 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:35.915899 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-545dcc9b6-svq48"] Nov 04 02:12:36.023010 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:36.022958 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dpq46"] Nov 04 02:12:36.027166 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:36.027149 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dpq46"] Nov 04 02:12:36.612968 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:36.612935 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0691db3f-a8d0-4d2e-9ed6-85d601af8df9" path="/var/lib/kubelet/pods/0691db3f-a8d0-4d2e-9ed6-85d601af8df9/volumes" Nov 04 02:12:36.613256 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:36.613234 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b" path="/var/lib/kubelet/pods/cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b/volumes" Nov 04 02:12:36.613569 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:36.613557 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cde57d10-3ac2-493f-8878-9017f25a7dae" path="/var/lib/kubelet/pods/cde57d10-3ac2-493f-8878-9017f25a7dae/volumes" Nov 04 02:12:38.930616 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:12:38.930583 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:12:39.136664 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.136632 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b"] Nov 04 02:12:39.136933 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.136921 5219 cpu_manager.go:414] "containerMap: removing container" podUID="0691db3f-a8d0-4d2e-9ed6-85d601af8df9" containerName="authorino" Nov 04 02:12:39.136980 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.136934 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0691db3f-a8d0-4d2e-9ed6-85d601af8df9" containerName="authorino" Nov 04 02:12:39.136980 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.136945 5219 cpu_manager.go:414] "containerMap: removing container" podUID="cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b" containerName="authorino" Nov 04 02:12:39.136980 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.136950 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b" containerName="authorino" Nov 04 02:12:39.136980 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.136958 5219 cpu_manager.go:414] "containerMap: removing container" podUID="cde57d10-3ac2-493f-8878-9017f25a7dae" containerName="authorino" Nov 04 02:12:39.136980 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.136963 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cde57d10-3ac2-493f-8878-9017f25a7dae" containerName="authorino" Nov 04 02:12:39.137121 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.137036 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="0691db3f-a8d0-4d2e-9ed6-85d601af8df9" containerName="authorino" Nov 04 02:12:39.137121 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.137044 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd8abfa4-7692-4fa5-8dd9-5cd60a0b683b" containerName="authorino" Nov 04 02:12:39.137121 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.137050 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="cde57d10-3ac2-493f-8878-9017f25a7dae" containerName="authorino" Nov 04 02:12:39.140227 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.140207 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.243395 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.243311 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Nov 04 02:12:39.243395 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.243311 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Nov 04 02:12:39.243617 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.243558 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Nov 04 02:12:39.244155 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.244135 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b"] Nov 04 02:12:39.246380 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.246367 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Nov 04 02:12:39.246427 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.246398 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Nov 04 02:12:39.246475 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.246459 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-mfwcx\"" Nov 04 02:12:39.265682 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.265656 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/38f73b02-0a29-4a19-8125-be25da1aab31-manager-config\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.265786 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.265686 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfkz6\" (UniqueName: \"kubernetes.io/projected/38f73b02-0a29-4a19-8125-be25da1aab31-kube-api-access-nfkz6\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.265786 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.265716 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38f73b02-0a29-4a19-8125-be25da1aab31-cert\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.265859 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.265844 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38f73b02-0a29-4a19-8125-be25da1aab31-metrics-certs\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.366927 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.366904 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/38f73b02-0a29-4a19-8125-be25da1aab31-manager-config\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.367040 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.366933 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfkz6\" (UniqueName: \"kubernetes.io/projected/38f73b02-0a29-4a19-8125-be25da1aab31-kube-api-access-nfkz6\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.367040 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.366956 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38f73b02-0a29-4a19-8125-be25da1aab31-cert\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.367040 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.366981 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38f73b02-0a29-4a19-8125-be25da1aab31-metrics-certs\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.367600 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.367577 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/38f73b02-0a29-4a19-8125-be25da1aab31-manager-config\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.369697 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.369669 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38f73b02-0a29-4a19-8125-be25da1aab31-cert\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.369777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.369681 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38f73b02-0a29-4a19-8125-be25da1aab31-metrics-certs\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.427649 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.427621 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfkz6\" (UniqueName: \"kubernetes.io/projected/38f73b02-0a29-4a19-8125-be25da1aab31-kube-api-access-nfkz6\") pod \"jobset-controller-manager-597f7d689d-ccg8b\" (UID: \"38f73b02-0a29-4a19-8125-be25da1aab31\") " pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.454367 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.454345 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:39.823749 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:39.823673 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b"] Nov 04 02:12:39.827164 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:12:39.827137 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f73b02_0a29_4a19_8125_be25da1aab31.slice/crio-169486ec5213a6c9533f0525d5ef0c881c50c7eef2d493cfd2d99756ea28da01 WatchSource:0}: Error finding container 169486ec5213a6c9533f0525d5ef0c881c50c7eef2d493cfd2d99756ea28da01: Status 404 returned error can't find the container with id 169486ec5213a6c9533f0525d5ef0c881c50c7eef2d493cfd2d99756ea28da01 Nov 04 02:12:40.771801 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:40.771769 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" event={"ID":"38f73b02-0a29-4a19-8125-be25da1aab31","Type":"ContainerStarted","Data":"169486ec5213a6c9533f0525d5ef0c881c50c7eef2d493cfd2d99756ea28da01"} Nov 04 02:12:43.792694 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:43.792590 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" event={"ID":"38f73b02-0a29-4a19-8125-be25da1aab31","Type":"ContainerStarted","Data":"cccb413b382d3d534c5d76503e4f21e53fb92a78d2c2107ec626d9fd07440cc9"} Nov 04 02:12:43.792694 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:43.792694 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:12:43.908813 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:43.908769 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" podStartSLOduration=1.289475875 podStartE2EDuration="4.908755918s" totalImagesPullingTime="3.619280043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:12:43.90788769 +0000 UTC m=+309.396396407" watchObservedRunningTime="2026-11-04 02:12:43.908755918 +0000 UTC m=+309.397264619" Nov 04 02:12:44.652038 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:44.652007 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:12:54.802113 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:12:54.802081 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-597f7d689d-ccg8b" Nov 04 02:13:08.930021 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:13:08.929984 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:13:16.248173 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.248136 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-txbbr"] Nov 04 02:13:16.255511 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.255483 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" Nov 04 02:13:16.309914 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.309875 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-txbbr"] Nov 04 02:13:16.366457 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.366426 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf514dd1-1434-4bfd-b61c-f1992fb82ea8-cert\") pod \"llmisvc-controller-manager-6466c554d8-txbbr\" (UID: \"bf514dd1-1434-4bfd-b61c-f1992fb82ea8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" Nov 04 02:13:16.366637 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.366476 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs7xf\" (UniqueName: \"kubernetes.io/projected/bf514dd1-1434-4bfd-b61c-f1992fb82ea8-kube-api-access-hs7xf\") pod \"llmisvc-controller-manager-6466c554d8-txbbr\" (UID: \"bf514dd1-1434-4bfd-b61c-f1992fb82ea8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" Nov 04 02:13:16.467117 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.467087 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf514dd1-1434-4bfd-b61c-f1992fb82ea8-cert\") pod \"llmisvc-controller-manager-6466c554d8-txbbr\" (UID: \"bf514dd1-1434-4bfd-b61c-f1992fb82ea8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" Nov 04 02:13:16.467322 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.467139 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs7xf\" (UniqueName: \"kubernetes.io/projected/bf514dd1-1434-4bfd-b61c-f1992fb82ea8-kube-api-access-hs7xf\") pod \"llmisvc-controller-manager-6466c554d8-txbbr\" (UID: \"bf514dd1-1434-4bfd-b61c-f1992fb82ea8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" Nov 04 02:13:16.469813 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.469775 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf514dd1-1434-4bfd-b61c-f1992fb82ea8-cert\") pod \"llmisvc-controller-manager-6466c554d8-txbbr\" (UID: \"bf514dd1-1434-4bfd-b61c-f1992fb82ea8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" Nov 04 02:13:16.528135 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.528053 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs7xf\" (UniqueName: \"kubernetes.io/projected/bf514dd1-1434-4bfd-b61c-f1992fb82ea8-kube-api-access-hs7xf\") pod \"llmisvc-controller-manager-6466c554d8-txbbr\" (UID: \"bf514dd1-1434-4bfd-b61c-f1992fb82ea8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" Nov 04 02:13:16.568425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.568381 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" Nov 04 02:13:16.946393 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:16.946363 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-txbbr"] Nov 04 02:13:16.950106 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:13:16.950078 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf514dd1_1434_4bfd_b61c_f1992fb82ea8.slice/crio-4d01765d710b7081f94fa1c0a488e2666c6c904e72ef3cd60139bd3fa1fe6dd9 WatchSource:0}: Error finding container 4d01765d710b7081f94fa1c0a488e2666c6c904e72ef3cd60139bd3fa1fe6dd9: Status 404 returned error can't find the container with id 4d01765d710b7081f94fa1c0a488e2666c6c904e72ef3cd60139bd3fa1fe6dd9 Nov 04 02:13:17.932095 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:17.932061 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" event={"ID":"bf514dd1-1434-4bfd-b61c-f1992fb82ea8","Type":"ContainerStarted","Data":"f071dbf75c1f308595af196b99290cf1b0e7f65e870e6a674c72f89f721f8771"} Nov 04 02:13:17.932508 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:17.932158 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" Nov 04 02:13:17.932508 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:17.932176 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" event={"ID":"bf514dd1-1434-4bfd-b61c-f1992fb82ea8","Type":"ContainerStarted","Data":"4d01765d710b7081f94fa1c0a488e2666c6c904e72ef3cd60139bd3fa1fe6dd9"} Nov 04 02:13:18.047871 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:18.047754 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" podStartSLOduration=1.281113316 podStartE2EDuration="2.047739129s" totalImagesPullingTime="766.625813ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:13:18.046779189 +0000 UTC m=+343.535287891" watchObservedRunningTime="2026-11-04 02:13:18.047739129 +0000 UTC m=+343.536247872" Nov 04 02:13:38.929732 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:13:38.929685 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:13:48.938878 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:48.938851 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-txbbr" Nov 04 02:13:49.105834 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:49.105792 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr"] Nov 04 02:13:49.106091 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:49.106062 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" podUID="523bc755-695f-47e4-b5de-1192fdf371b0" containerName="manager" containerID="cri-o://96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a" gracePeriod=30 Nov 04 02:13:49.349435 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:49.349409 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:13:49.440079 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:49.440034 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/523bc755-695f-47e4-b5de-1192fdf371b0-cert\" (UniqueName: \"kubernetes.io/secret/523bc755-695f-47e4-b5de-1192fdf371b0-cert\") pod \"523bc755-695f-47e4-b5de-1192fdf371b0\" (UID: \"523bc755-695f-47e4-b5de-1192fdf371b0\") " Nov 04 02:13:49.440079 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:49.440080 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/523bc755-695f-47e4-b5de-1192fdf371b0-kube-api-access-nnsnq\" (UniqueName: \"kubernetes.io/projected/523bc755-695f-47e4-b5de-1192fdf371b0-kube-api-access-nnsnq\") pod \"523bc755-695f-47e4-b5de-1192fdf371b0\" (UID: \"523bc755-695f-47e4-b5de-1192fdf371b0\") " Nov 04 02:13:49.442407 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:49.442374 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/523bc755-695f-47e4-b5de-1192fdf371b0-cert" pod "523bc755-695f-47e4-b5de-1192fdf371b0" (UID: "523bc755-695f-47e4-b5de-1192fdf371b0"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:13:49.442505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:49.442425 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/523bc755-695f-47e4-b5de-1192fdf371b0-kube-api-access-nnsnq" pod "523bc755-695f-47e4-b5de-1192fdf371b0" (UID: "523bc755-695f-47e4-b5de-1192fdf371b0"). InnerVolumeSpecName "kube-api-access-nnsnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:13:49.541046 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:49.540961 5219 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/523bc755-695f-47e4-b5de-1192fdf371b0-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:13:49.541046 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:49.540999 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnsnq\" (UniqueName: \"kubernetes.io/projected/523bc755-695f-47e4-b5de-1192fdf371b0-kube-api-access-nnsnq\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:13:50.063437 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:50.063403 5219 generic.go:356] "Generic (PLEG): container finished" podID="523bc755-695f-47e4-b5de-1192fdf371b0" containerID="96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a" exitCode=0 Nov 04 02:13:50.063869 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:50.063447 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" Nov 04 02:13:50.063869 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:50.063484 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" event={"ID":"523bc755-695f-47e4-b5de-1192fdf371b0","Type":"ContainerDied","Data":"96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a"} Nov 04 02:13:50.063869 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:50.063539 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr" event={"ID":"523bc755-695f-47e4-b5de-1192fdf371b0","Type":"ContainerDied","Data":"619e60f191cf843908b23e85185df74f8c4e192e56c815c636f288ba9a31e906"} Nov 04 02:13:50.063869 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:50.063560 5219 scope.go:122] "RemoveContainer" containerID="96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a" Nov 04 02:13:50.072018 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:50.071998 5219 scope.go:122] "RemoveContainer" containerID="96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a" Nov 04 02:13:50.072345 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:13:50.072329 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a\": container with ID starting with 96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a not found: ID does not exist" containerID="96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a" Nov 04 02:13:50.072389 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:50.072355 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a"} err="failed to get container status \"96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a\": rpc error: code = NotFound desc = could not find container \"96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a\": container with ID starting with 96c2f5dbfd570bfa5e75cf0477b2e453e1829dc5079ed5be3dedb2449ff2431a not found: ID does not exist" Nov 04 02:13:50.228956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:50.228925 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr"] Nov 04 02:13:50.278344 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:50.278310 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dwnhr"] Nov 04 02:13:50.613659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:13:50.613628 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="523bc755-695f-47e4-b5de-1192fdf371b0" path="/var/lib/kubelet/pods/523bc755-695f-47e4-b5de-1192fdf371b0/volumes" Nov 04 02:14:08.930379 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:14:08.930338 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:14:12.719833 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:12.719792 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:14:19.791277 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:19.791241 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:14:32.876038 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:32.876000 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:14:38.931438 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:14:38.931400 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:14:44.207649 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:44.207607 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:14:51.098195 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.098156 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv"] Nov 04 02:14:51.098669 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.098518 5219 cpu_manager.go:414] "containerMap: removing container" podUID="523bc755-695f-47e4-b5de-1192fdf371b0" containerName="manager" Nov 04 02:14:51.098669 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.098531 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="523bc755-695f-47e4-b5de-1192fdf371b0" containerName="manager" Nov 04 02:14:51.098669 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.098597 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="523bc755-695f-47e4-b5de-1192fdf371b0" containerName="manager" Nov 04 02:14:51.102468 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.102452 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.154355 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.154322 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vnp8f\"" Nov 04 02:14:51.257330 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.257267 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.257494 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.257337 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.257494 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.257434 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98jsd\" (UniqueName: \"kubernetes.io/projected/9cec65b0-de49-43c6-a296-85a3a78ea2c8-kube-api-access-98jsd\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.257573 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.257546 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.257615 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.257585 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.257615 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.257605 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.257711 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.257688 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.257761 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.257750 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.257799 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.257769 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.304806 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.304772 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv"] Nov 04 02:14:51.359205 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359115 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359205 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359160 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359205 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359183 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359691 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359219 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359691 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359244 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359691 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359264 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359691 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359331 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359691 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359360 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359691 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359638 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359687 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98jsd\" (UniqueName: \"kubernetes.io/projected/9cec65b0-de49-43c6-a296-85a3a78ea2c8-kube-api-access-98jsd\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359699 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359689 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.359999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.359968 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.360389 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.360177 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.361689 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.361666 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.362011 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.361995 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.422744 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.422703 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cec65b0-de49-43c6-a296-85a3a78ea2c8-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.422919 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.422864 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98jsd\" (UniqueName: \"kubernetes.io/projected/9cec65b0-de49-43c6-a296-85a3a78ea2c8-kube-api-access-98jsd\") pod \"maas-default-gateway-openshift-default-6cc458d887-plrsv\" (UID: \"9cec65b0-de49-43c6-a296-85a3a78ea2c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:51.715252 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:51.715222 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:52.245729 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:52.245686 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv"] Nov 04 02:14:52.249334 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:14:52.249306 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cec65b0_de49_43c6_a296_85a3a78ea2c8.slice/crio-6b468340c4f25afb6257d19dda6b03ca4d7d9eb7e07a7347a71cdd15ce731469 WatchSource:0}: Error finding container 6b468340c4f25afb6257d19dda6b03ca4d7d9eb7e07a7347a71cdd15ce731469: Status 404 returned error can't find the container with id 6b468340c4f25afb6257d19dda6b03ca4d7d9eb7e07a7347a71cdd15ce731469 Nov 04 02:14:52.251185 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:52.251169 5219 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 02:14:52.313177 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:52.313146 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" event={"ID":"9cec65b0-de49-43c6-a296-85a3a78ea2c8","Type":"ContainerStarted","Data":"6b468340c4f25afb6257d19dda6b03ca4d7d9eb7e07a7347a71cdd15ce731469"} Nov 04 02:14:57.831083 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:57.831047 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:14:57.831433 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:57.831122 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:14:57.831433 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:57.831153 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:14:58.345688 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:58.345653 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" event={"ID":"9cec65b0-de49-43c6-a296-85a3a78ea2c8","Type":"ContainerStarted","Data":"3abc4cc10c0a85fab125e36c0067e9c99dbf5d2d827b15f75438285dcbf3a109"} Nov 04 02:14:58.509489 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:58.509427 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" podStartSLOduration=1.930497469 podStartE2EDuration="7.509407973s" totalImagesPullingTime="5.578910504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:14:58.508854249 +0000 UTC m=+443.997362948" watchObservedRunningTime="2026-11-04 02:14:58.509407973 +0000 UTC m=+443.997916674" Nov 04 02:14:58.727710 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:58.727676 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:14:58.736501 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:58.736464 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-plrsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Nov 04 02:14:58.736794 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:58.736764 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" podUID="9cec65b0-de49-43c6-a296-85a3a78ea2c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Nov 04 02:14:59.734766 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:59.734723 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-plrsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Nov 04 02:14:59.735430 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:14:59.735382 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" podUID="9cec65b0-de49-43c6-a296-85a3a78ea2c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Nov 04 02:15:00.725312 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:00.724395 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-plrsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Nov 04 02:15:00.725312 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:00.724457 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" podUID="9cec65b0-de49-43c6-a296-85a3a78ea2c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Nov 04 02:15:01.720311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:01.719418 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-plrsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Nov 04 02:15:01.720311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:01.719481 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" podUID="9cec65b0-de49-43c6-a296-85a3a78ea2c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Nov 04 02:15:02.087890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.087807 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f5844cb4-pm56f"] Nov 04 02:15:02.088061 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.087998 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-58f5844cb4-pm56f" podUID="0ca7556c-8563-4e4f-a0d2-b47b94d471b8" containerName="authorino" containerID="cri-o://1b51f23d9e1c1261434d4900fc92e35e4fd240397fe8b93f62e59b1f6ff8b5ac" gracePeriod=30 Nov 04 02:15:02.363343 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.363245 5219 generic.go:356] "Generic (PLEG): container finished" podID="0ca7556c-8563-4e4f-a0d2-b47b94d471b8" containerID="1b51f23d9e1c1261434d4900fc92e35e4fd240397fe8b93f62e59b1f6ff8b5ac" exitCode=0 Nov 04 02:15:02.363492 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.363332 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f5844cb4-pm56f" event={"ID":"0ca7556c-8563-4e4f-a0d2-b47b94d471b8","Type":"ContainerDied","Data":"1b51f23d9e1c1261434d4900fc92e35e4fd240397fe8b93f62e59b1f6ff8b5ac"} Nov 04 02:15:02.385449 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.385427 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f5844cb4-pm56f" Nov 04 02:15:02.466547 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.466515 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-tls-cert\" (UniqueName: \"kubernetes.io/secret/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-tls-cert\") pod \"0ca7556c-8563-4e4f-a0d2-b47b94d471b8\" (UID: \"0ca7556c-8563-4e4f-a0d2-b47b94d471b8\") " Nov 04 02:15:02.466729 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.466605 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-kube-api-access-lrcbk\" (UniqueName: \"kubernetes.io/projected/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-kube-api-access-lrcbk\") pod \"0ca7556c-8563-4e4f-a0d2-b47b94d471b8\" (UID: \"0ca7556c-8563-4e4f-a0d2-b47b94d471b8\") " Nov 04 02:15:02.469431 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.469400 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-kube-api-access-lrcbk" pod "0ca7556c-8563-4e4f-a0d2-b47b94d471b8" (UID: "0ca7556c-8563-4e4f-a0d2-b47b94d471b8"). InnerVolumeSpecName "kube-api-access-lrcbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:15:02.476430 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.476400 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-tls-cert" pod "0ca7556c-8563-4e4f-a0d2-b47b94d471b8" (UID: "0ca7556c-8563-4e4f-a0d2-b47b94d471b8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:15:02.567717 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.567678 5219 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-tls-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:15:02.567717 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.567711 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrcbk\" (UniqueName: \"kubernetes.io/projected/0ca7556c-8563-4e4f-a0d2-b47b94d471b8-kube-api-access-lrcbk\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:15:02.720199 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.719727 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-plrsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Nov 04 02:15:02.720199 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:02.719793 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" podUID="9cec65b0-de49-43c6-a296-85a3a78ea2c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Nov 04 02:15:03.368113 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:03.368030 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f5844cb4-pm56f" Nov 04 02:15:03.368113 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:03.368066 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f5844cb4-pm56f" event={"ID":"0ca7556c-8563-4e4f-a0d2-b47b94d471b8","Type":"ContainerDied","Data":"8f07c707d9f5870f382a0cb9273c81daed36756bb47b83d35a6f6092034dcf7c"} Nov 04 02:15:03.368319 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:03.368126 5219 scope.go:122] "RemoveContainer" containerID="1b51f23d9e1c1261434d4900fc92e35e4fd240397fe8b93f62e59b1f6ff8b5ac" Nov 04 02:15:03.538741 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:03.538707 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f5844cb4-pm56f"] Nov 04 02:15:03.542807 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:03.542779 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58f5844cb4-pm56f"] Nov 04 02:15:03.716369 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:03.716336 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-plrsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Nov 04 02:15:03.716547 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:03.716409 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" podUID="9cec65b0-de49-43c6-a296-85a3a78ea2c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Nov 04 02:15:04.613820 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:04.613780 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ca7556c-8563-4e4f-a0d2-b47b94d471b8" path="/var/lib/kubelet/pods/0ca7556c-8563-4e4f-a0d2-b47b94d471b8/volumes" Nov 04 02:15:04.716245 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:04.716213 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-plrsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Nov 04 02:15:04.716436 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:04.716268 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" podUID="9cec65b0-de49-43c6-a296-85a3a78ea2c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Nov 04 02:15:06.077956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.077920 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:15:06.078505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.078472 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:15:06.079658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.079631 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-plrsv" Nov 04 02:15:06.248573 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.248544 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm"] Nov 04 02:15:06.248850 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.248839 5219 cpu_manager.go:414] "containerMap: removing container" podUID="0ca7556c-8563-4e4f-a0d2-b47b94d471b8" containerName="authorino" Nov 04 02:15:06.248892 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.248852 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ca7556c-8563-4e4f-a0d2-b47b94d471b8" containerName="authorino" Nov 04 02:15:06.248925 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.248913 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ca7556c-8563-4e4f-a0d2-b47b94d471b8" containerName="authorino" Nov 04 02:15:06.253374 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.253354 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.298637 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.298595 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.298637 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.298641 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.298886 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.298725 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2d9h\" (UniqueName: \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-kube-api-access-k2d9h\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.298886 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.298749 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.298886 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.298771 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.298886 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.298791 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.299020 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.298937 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32e86ed3-6262-455d-a68b-5fb509188cab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.299020 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.298979 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32e86ed3-6262-455d-a68b-5fb509188cab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.299020 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.299006 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.368097 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.368006 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm"] Nov 04 02:15:06.400057 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400027 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32e86ed3-6262-455d-a68b-5fb509188cab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.400247 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400085 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32e86ed3-6262-455d-a68b-5fb509188cab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.400247 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400155 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.400404 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400259 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.400404 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400308 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.400404 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400368 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2d9h\" (UniqueName: \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-kube-api-access-k2d9h\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.400544 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400400 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.400544 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400429 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.400544 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400454 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.400686 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400601 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.400854 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400830 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.401022 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400931 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.401022 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.400975 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.401196 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.401020 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32e86ed3-6262-455d-a68b-5fb509188cab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.402629 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.402609 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32e86ed3-6262-455d-a68b-5fb509188cab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.402707 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.402674 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.461777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.461745 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.461927 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.461828 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2d9h\" (UniqueName: \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-kube-api-access-k2d9h\") pod \"maas-default-gateway-openshift-default-6cc458d887-j8dtm\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.565895 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.565841 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:06.997100 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:06.996579 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm"] Nov 04 02:15:07.001182 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:15:07.001156 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e86ed3_6262_455d_a68b_5fb509188cab.slice/crio-57d3154c87194819764eb058288fd8bab1b3ce10baeee734740e04f392339d6d WatchSource:0}: Error finding container 57d3154c87194819764eb058288fd8bab1b3ce10baeee734740e04f392339d6d: Status 404 returned error can't find the container with id 57d3154c87194819764eb058288fd8bab1b3ce10baeee734740e04f392339d6d Nov 04 02:15:07.003353 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:07.003322 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:15:07.003428 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:07.003383 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:15:07.003428 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:07.003415 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:15:07.396108 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:07.396016 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" event={"ID":"32e86ed3-6262-455d-a68b-5fb509188cab","Type":"ContainerStarted","Data":"eb01a63c174f5013422f64b738d2a2bfa4c2f503353d877465383b8396990e50"} Nov 04 02:15:07.396108 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:07.396074 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" event={"ID":"32e86ed3-6262-455d-a68b-5fb509188cab","Type":"ContainerStarted","Data":"57d3154c87194819764eb058288fd8bab1b3ce10baeee734740e04f392339d6d"} Nov 04 02:15:07.566693 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:07.566267 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" podStartSLOduration=1.5662469209999998 podStartE2EDuration="1.566246921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:07.565674776 +0000 UTC m=+453.054183475" watchObservedRunningTime="2026-11-04 02:15:07.566246921 +0000 UTC m=+453.054755622" Nov 04 02:15:07.566693 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:07.566641 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:08.568026 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:08.567992 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-j8dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Nov 04 02:15:08.568458 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:08.568049 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Nov 04 02:15:08.950700 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:15:08.950670 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:15:09.566646 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:09.566605 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-j8dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Nov 04 02:15:09.566831 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:09.566666 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Nov 04 02:15:10.566992 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:10.566954 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-j8dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Nov 04 02:15:10.567513 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:10.567050 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Nov 04 02:15:11.566779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:11.566741 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-j8dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Nov 04 02:15:11.566950 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:11.566810 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Nov 04 02:15:12.566426 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:12.566260 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-j8dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Nov 04 02:15:12.567362 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:12.566962 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Nov 04 02:15:13.566367 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:13.566317 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-j8dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Nov 04 02:15:13.566581 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:13.566386 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Nov 04 02:15:15.567406 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:15.567355 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-j8dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 02:15:15.567821 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:15.567439 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 02:15:16.611117 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:16.610405 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-j8dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 02:15:16.611117 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:16.610466 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 02:15:17.516200 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:17.516168 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:17.516583 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:17.516564 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:17.517211 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:17.517196 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:15:36.443837 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.443804 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g"] Nov 04 02:15:36.448391 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.448371 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.550780 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.550743 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g"] Nov 04 02:15:36.568625 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.568596 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.568625 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.568628 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.568871 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.568651 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.568871 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.568669 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.568871 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.568763 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.569019 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.568933 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.569019 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.568992 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.569095 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.569076 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.569159 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.569139 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4rjr\" (UniqueName: \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-kube-api-access-j4rjr\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.670392 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670356 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.670392 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670390 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.670690 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670412 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.670690 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670438 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.670690 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670462 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.670690 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670522 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.670690 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670565 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.670690 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670597 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.670690 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670645 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4rjr\" (UniqueName: \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-kube-api-access-j4rjr\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.671025 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670858 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.671025 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.670945 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.671116 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.671043 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.671116 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.671098 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.671401 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.671381 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.672832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.672810 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.673029 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.673013 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.731073 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.731005 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.731196 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.731116 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4rjr\" (UniqueName: \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-kube-api-access-j4rjr\") pod \"maas-default-gateway-openshift-default-6cc458d887-hqs5g\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:36.760017 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:36.759988 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:37.184576 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:37.184492 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g"] Nov 04 02:15:37.189055 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:15:37.189027 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef9f4e1_ad1c_4578_b9aa_dd226508698a.slice/crio-70f579a3766729150b620d8548aff4b5a314c3828044bd5f0388044db035988c WatchSource:0}: Error finding container 70f579a3766729150b620d8548aff4b5a314c3828044bd5f0388044db035988c: Status 404 returned error can't find the container with id 70f579a3766729150b620d8548aff4b5a314c3828044bd5f0388044db035988c Nov 04 02:15:37.191241 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:37.191209 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:15:37.191311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:37.191274 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:15:37.191355 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:37.191333 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:15:37.520132 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:37.520049 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" event={"ID":"0ef9f4e1-ad1c-4578-b9aa-dd226508698a","Type":"ContainerStarted","Data":"cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5"} Nov 04 02:15:37.520132 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:37.520117 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" event={"ID":"0ef9f4e1-ad1c-4578-b9aa-dd226508698a","Type":"ContainerStarted","Data":"70f579a3766729150b620d8548aff4b5a314c3828044bd5f0388044db035988c"} Nov 04 02:15:37.760746 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:37.760703 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:38.762241 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:38.762203 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hqs5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Nov 04 02:15:38.762656 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:38.762259 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Nov 04 02:15:38.951486 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:15:38.951449 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:15:39.760890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:39.760858 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hqs5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Nov 04 02:15:39.761075 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:39.760913 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Nov 04 02:15:40.760916 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:40.760882 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hqs5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Nov 04 02:15:40.761319 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:40.760931 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Nov 04 02:15:41.760736 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:41.760696 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hqs5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Nov 04 02:15:41.760921 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:41.760750 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Nov 04 02:15:42.761013 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:42.760974 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hqs5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Nov 04 02:15:42.761518 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:42.761038 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Nov 04 02:15:43.760897 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:43.760859 5219 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hqs5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Nov 04 02:15:43.761072 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:43.760927 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Nov 04 02:15:45.470713 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:45.470675 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:45.471119 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:45.470992 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:45.471721 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:45.471701 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:15:45.640848 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:15:45.640796 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" podStartSLOduration=9.640781619 podStartE2EDuration="9.640781619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:37.642195769 +0000 UTC m=+483.130704469" watchObservedRunningTime="2026-11-04 02:15:45.640781619 +0000 UTC m=+491.129290378" Nov 04 02:16:08.933475 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:16:08.933439 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:16:26.973519 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:26.973434 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:16:34.976627 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:34.976589 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7"] Nov 04 02:16:34.979845 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:34.979828 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:16:35.032201 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.032166 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-8cf267\"" Nov 04 02:16:35.085628 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.085592 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-8cf267-dockercfg-zz682\"" Nov 04 02:16:35.086989 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.086957 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7"] Nov 04 02:16:35.120110 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.120075 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qc9b\" (UniqueName: \"kubernetes.io/projected/e429a663-e33a-4104-baf1-9b208d58ab22-kube-api-access-6qc9b\") pod \"payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7\" (UID: \"e429a663-e33a-4104-baf1-9b208d58ab22\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:16:35.120275 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.120136 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e429a663-e33a-4104-baf1-9b208d58ab22-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7\" (UID: \"e429a663-e33a-4104-baf1-9b208d58ab22\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:16:35.221372 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.221336 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qc9b\" (UniqueName: \"kubernetes.io/projected/e429a663-e33a-4104-baf1-9b208d58ab22-kube-api-access-6qc9b\") pod \"payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7\" (UID: \"e429a663-e33a-4104-baf1-9b208d58ab22\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:16:35.221541 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.221419 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e429a663-e33a-4104-baf1-9b208d58ab22-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7\" (UID: \"e429a663-e33a-4104-baf1-9b208d58ab22\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:16:35.222133 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.222112 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e429a663-e33a-4104-baf1-9b208d58ab22-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7\" (UID: \"e429a663-e33a-4104-baf1-9b208d58ab22\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:16:35.282258 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.282195 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qc9b\" (UniqueName: \"kubernetes.io/projected/e429a663-e33a-4104-baf1-9b208d58ab22-kube-api-access-6qc9b\") pod \"payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7\" (UID: \"e429a663-e33a-4104-baf1-9b208d58ab22\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:16:35.291871 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.291847 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:16:35.663256 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.663174 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7"] Nov 04 02:16:35.666866 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:16:35.666830 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode429a663_e33a_4104_baf1_9b208d58ab22.slice/crio-0231266edd2a14149fb10a22f50298ca857f359903a2fd20d107d3c8a50ae5a4 WatchSource:0}: Error finding container 0231266edd2a14149fb10a22f50298ca857f359903a2fd20d107d3c8a50ae5a4: Status 404 returned error can't find the container with id 0231266edd2a14149fb10a22f50298ca857f359903a2fd20d107d3c8a50ae5a4 Nov 04 02:16:35.792453 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:35.792424 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" event={"ID":"e429a663-e33a-4104-baf1-9b208d58ab22","Type":"ContainerStarted","Data":"0231266edd2a14149fb10a22f50298ca857f359903a2fd20d107d3c8a50ae5a4"} Nov 04 02:16:36.402740 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:36.402698 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:16:38.806399 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:38.806362 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" event={"ID":"e429a663-e33a-4104-baf1-9b208d58ab22","Type":"ContainerStarted","Data":"3f491efe629855ba0fd41b24c8a83ac116cf1c3c99df31bf42f23423e897c985"} Nov 04 02:16:38.806788 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:38.806452 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:16:38.921627 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:38.921532 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" podStartSLOduration=2.020684072 podStartE2EDuration="4.921515985s" totalImagesPullingTime="2.900831913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:38.920333795 +0000 UTC m=+544.408842495" watchObservedRunningTime="2026-11-04 02:16:38.921515985 +0000 UTC m=+544.410024684" Nov 04 02:16:38.931831 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:16:38.931796 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:16:39.932770 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:39.932738 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq"] Nov 04 02:16:39.935971 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:39.935954 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:16:39.988964 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:39.988941 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-e970c7\"" Nov 04 02:16:40.037526 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.037493 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-e970c7-dockercfg-4ftqq\"" Nov 04 02:16:40.039121 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.039088 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq"] Nov 04 02:16:40.071086 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.071051 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57cdc8cd-3b59-4081-a93d-1a42043ff046-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq\" (UID: \"57cdc8cd-3b59-4081-a93d-1a42043ff046\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:16:40.071086 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.071086 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nnc8\" (UniqueName: \"kubernetes.io/projected/57cdc8cd-3b59-4081-a93d-1a42043ff046-kube-api-access-6nnc8\") pod \"payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq\" (UID: \"57cdc8cd-3b59-4081-a93d-1a42043ff046\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:16:40.075028 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.075002 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494"] Nov 04 02:16:40.078167 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.078149 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:16:40.136822 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.136793 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494"] Nov 04 02:16:40.171980 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.171950 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57cdc8cd-3b59-4081-a93d-1a42043ff046-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq\" (UID: \"57cdc8cd-3b59-4081-a93d-1a42043ff046\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:16:40.172130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.171983 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nnc8\" (UniqueName: \"kubernetes.io/projected/57cdc8cd-3b59-4081-a93d-1a42043ff046-kube-api-access-6nnc8\") pod \"payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq\" (UID: \"57cdc8cd-3b59-4081-a93d-1a42043ff046\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:16:40.172130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.172043 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccvxk\" (UniqueName: \"kubernetes.io/projected/77ca6e9c-edc4-4d12-a75e-96c056086871-kube-api-access-ccvxk\") pod \"payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494\" (UID: \"77ca6e9c-edc4-4d12-a75e-96c056086871\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:16:40.172130 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.172089 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77ca6e9c-edc4-4d12-a75e-96c056086871-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494\" (UID: \"77ca6e9c-edc4-4d12-a75e-96c056086871\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:16:40.172679 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.172663 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57cdc8cd-3b59-4081-a93d-1a42043ff046-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq\" (UID: \"57cdc8cd-3b59-4081-a93d-1a42043ff046\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:16:40.232966 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.232889 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nnc8\" (UniqueName: \"kubernetes.io/projected/57cdc8cd-3b59-4081-a93d-1a42043ff046-kube-api-access-6nnc8\") pod \"payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq\" (UID: \"57cdc8cd-3b59-4081-a93d-1a42043ff046\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:16:40.248024 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.247995 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:16:40.272599 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.272575 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77ca6e9c-edc4-4d12-a75e-96c056086871-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494\" (UID: \"77ca6e9c-edc4-4d12-a75e-96c056086871\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:16:40.272731 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.272667 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccvxk\" (UniqueName: \"kubernetes.io/projected/77ca6e9c-edc4-4d12-a75e-96c056086871-kube-api-access-ccvxk\") pod \"payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494\" (UID: \"77ca6e9c-edc4-4d12-a75e-96c056086871\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:16:40.273329 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.273309 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77ca6e9c-edc4-4d12-a75e-96c056086871-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494\" (UID: \"77ca6e9c-edc4-4d12-a75e-96c056086871\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:16:40.333015 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.332990 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccvxk\" (UniqueName: \"kubernetes.io/projected/77ca6e9c-edc4-4d12-a75e-96c056086871-kube-api-access-ccvxk\") pod \"payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494\" (UID: \"77ca6e9c-edc4-4d12-a75e-96c056086871\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:16:40.391141 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.391112 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:16:40.619424 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.619347 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq"] Nov 04 02:16:40.622670 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:16:40.622642 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cdc8cd_3b59_4081_a93d_1a42043ff046.slice/crio-aaf43033d1482e00c9d2e1b31182838fa8e2afb1c8eff3a2c5bf4ad5ae84970e WatchSource:0}: Error finding container aaf43033d1482e00c9d2e1b31182838fa8e2afb1c8eff3a2c5bf4ad5ae84970e: Status 404 returned error can't find the container with id aaf43033d1482e00c9d2e1b31182838fa8e2afb1c8eff3a2c5bf4ad5ae84970e Nov 04 02:16:40.763810 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.763770 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494"] Nov 04 02:16:40.767872 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:16:40.767835 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ca6e9c_edc4_4d12_a75e_96c056086871.slice/crio-752e251acbcb7b091ff506224df9b9a753664a6cee064e7ba9dad0e28f8b099d WatchSource:0}: Error finding container 752e251acbcb7b091ff506224df9b9a753664a6cee064e7ba9dad0e28f8b099d: Status 404 returned error can't find the container with id 752e251acbcb7b091ff506224df9b9a753664a6cee064e7ba9dad0e28f8b099d Nov 04 02:16:40.819312 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.819099 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" event={"ID":"57cdc8cd-3b59-4081-a93d-1a42043ff046","Type":"ContainerStarted","Data":"83db85ee95f3a631a3522fb4b143465f7c218aec4df46027a3e83aa749e5a00b"} Nov 04 02:16:40.819312 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.819163 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" event={"ID":"57cdc8cd-3b59-4081-a93d-1a42043ff046","Type":"ContainerStarted","Data":"aaf43033d1482e00c9d2e1b31182838fa8e2afb1c8eff3a2c5bf4ad5ae84970e"} Nov 04 02:16:40.819465 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.819391 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:16:40.821389 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.821366 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" event={"ID":"77ca6e9c-edc4-4d12-a75e-96c056086871","Type":"ContainerStarted","Data":"752e251acbcb7b091ff506224df9b9a753664a6cee064e7ba9dad0e28f8b099d"} Nov 04 02:16:40.935966 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:40.935905 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" podStartSLOduration=1.935886026 podStartE2EDuration="1.935886026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:40.934684097 +0000 UTC m=+546.423192798" watchObservedRunningTime="2026-11-04 02:16:40.935886026 +0000 UTC m=+546.424394727" Nov 04 02:16:41.826541 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:41.826510 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" event={"ID":"77ca6e9c-edc4-4d12-a75e-96c056086871","Type":"ContainerStarted","Data":"269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d"} Nov 04 02:16:41.826758 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:41.826626 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:16:41.945946 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:41.945889 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" podStartSLOduration=1.9458752540000002 podStartE2EDuration="1.945875254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:41.945502053 +0000 UTC m=+547.434010754" watchObservedRunningTime="2026-11-04 02:16:41.945875254 +0000 UTC m=+547.434383954" Nov 04 02:16:46.990069 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:46.990034 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:16:49.815447 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:49.815421 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:16:51.830110 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:51.830082 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:16:52.834774 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:52.834739 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:16:58.276314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:16:58.276262 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:17:07.313016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:07.312975 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:17:08.929027 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:17:08.928986 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:17:11.651252 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.651217 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb"] Nov 04 02:17:11.658244 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.658224 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.760386 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.760357 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ff17d7d-a35e-4fda-bd78-61d26642f720-tls-certs\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.760540 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.760394 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-model-cache\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.760540 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.760411 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r2cx\" (UniqueName: \"kubernetes.io/projected/7ff17d7d-a35e-4fda-bd78-61d26642f720-kube-api-access-8r2cx\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.760540 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.760469 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-dshm\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.760710 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.760572 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-tmp-dir\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.760710 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.760643 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-home\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.760866 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.760846 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e34b54\"/\"openshift-service-ca.crt\"" Nov 04 02:17:11.760919 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.760901 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e34b54\"/\"kube-root-ca.crt\"" Nov 04 02:17:11.760966 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.760931 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e34b54\"/\"default-dockercfg-8gsrg\"" Nov 04 02:17:11.761017 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.760983 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e34b54\"/\"simulator-w0-e34b54-kserve-self-signed-certs\"" Nov 04 02:17:11.761980 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.761956 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb"] Nov 04 02:17:11.861901 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.861869 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ff17d7d-a35e-4fda-bd78-61d26642f720-tls-certs\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.862104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.861918 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-model-cache\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.862104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.861951 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r2cx\" (UniqueName: \"kubernetes.io/projected/7ff17d7d-a35e-4fda-bd78-61d26642f720-kube-api-access-8r2cx\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.862104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.861980 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-dshm\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.862104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.862006 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-tmp-dir\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.862104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.862040 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-home\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.862458 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.862434 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-model-cache\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.862514 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.862483 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-tmp-dir\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.862571 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.862551 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-home\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.864486 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.864454 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-dshm\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.864739 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.864720 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ff17d7d-a35e-4fda-bd78-61d26642f720-tls-certs\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.922793 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.922765 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r2cx\" (UniqueName: \"kubernetes.io/projected/7ff17d7d-a35e-4fda-bd78-61d26642f720-kube-api-access-8r2cx\") pod \"simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:11.969842 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:11.969810 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:12.345077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:12.344994 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb"] Nov 04 02:17:12.348746 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:17:12.348703 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ff17d7d_a35e_4fda_bd78_61d26642f720.slice/crio-7f6a2410f21459a6f782b1a1cab2de18be9cfb1b411e8a3bed9f5e6130a246a2 WatchSource:0}: Error finding container 7f6a2410f21459a6f782b1a1cab2de18be9cfb1b411e8a3bed9f5e6130a246a2: Status 404 returned error can't find the container with id 7f6a2410f21459a6f782b1a1cab2de18be9cfb1b411e8a3bed9f5e6130a246a2 Nov 04 02:17:12.960687 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:12.960658 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" event={"ID":"7ff17d7d-a35e-4fda-bd78-61d26642f720","Type":"ContainerStarted","Data":"7f6a2410f21459a6f782b1a1cab2de18be9cfb1b411e8a3bed9f5e6130a246a2"} Nov 04 02:17:14.970583 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:14.970552 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" event={"ID":"7ff17d7d-a35e-4fda-bd78-61d26642f720","Type":"ContainerStarted","Data":"da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332"} Nov 04 02:17:15.094706 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:15.091209 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" podStartSLOduration=1.834505069 podStartE2EDuration="4.091180689s" totalImagesPullingTime="2.25667562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:17:15.089868313 +0000 UTC m=+580.578377004" watchObservedRunningTime="2026-11-04 02:17:15.091180689 +0000 UTC m=+580.579689391" Nov 04 02:17:15.970806 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:15.970773 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:21.970142 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:21.970106 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:21.982554 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:21.982525 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:22.027352 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:22.027321 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:17:26.497794 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:26.497761 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:17:34.695354 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:34.695323 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:17:34.708190 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:34.708171 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:17:36.588192 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.585744 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb"] Nov 04 02:17:36.590730 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.590707 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.597251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.596972 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-model-cache\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.597251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.597046 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-tmp-dir\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.597382 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.597263 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-home\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.597382 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.597321 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6994b72-f668-44d8-ae8a-9d27011cea95-tls-certs\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.597382 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.597352 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlf45\" (UniqueName: \"kubernetes.io/projected/d6994b72-f668-44d8-ae8a-9d27011cea95-kube-api-access-zlf45\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.597382 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.597375 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-dshm\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.695260 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.695219 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-dd5d18\"/\"openshift-service-ca.crt\"" Nov 04 02:17:36.695260 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.695219 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-dd5d18\"/\"kube-root-ca.crt\"" Nov 04 02:17:36.695260 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.695219 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-dd5d18\"/\"default-dockercfg-gszng\"" Nov 04 02:17:36.695566 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.695382 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-dd5d18\"/\"simulator-w5-dd5d18-kserve-self-signed-certs\"" Nov 04 02:17:36.696409 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.696386 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb"] Nov 04 02:17:36.697916 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.697901 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-dshm\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.697968 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.697933 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-model-cache\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.698002 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.697966 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-tmp-dir\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.698175 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.698151 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-home\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.698241 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.698204 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6994b72-f668-44d8-ae8a-9d27011cea95-tls-certs\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.698307 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.698248 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlf45\" (UniqueName: \"kubernetes.io/projected/d6994b72-f668-44d8-ae8a-9d27011cea95-kube-api-access-zlf45\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.698457 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.698416 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-tmp-dir\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.698584 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.698492 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-model-cache\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.698665 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.698645 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-home\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.700338 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.700315 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-dshm\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.700669 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.700648 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6994b72-f668-44d8-ae8a-9d27011cea95-tls-certs\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.759702 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.759668 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlf45\" (UniqueName: \"kubernetes.io/projected/d6994b72-f668-44d8-ae8a-9d27011cea95-kube-api-access-zlf45\") pod \"simulator-w5-dd5d18-kserve-5d57888c88-k6zfb\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:36.902536 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:36.902435 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:37.277680 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:37.277600 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb"] Nov 04 02:17:37.281492 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:17:37.281461 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6994b72_f668_44d8_ae8a_9d27011cea95.slice/crio-0900ef7902390d33711a1ee5389787157e7cb42970bda342940fb0fc1bf38487 WatchSource:0}: Error finding container 0900ef7902390d33711a1ee5389787157e7cb42970bda342940fb0fc1bf38487: Status 404 returned error can't find the container with id 0900ef7902390d33711a1ee5389787157e7cb42970bda342940fb0fc1bf38487 Nov 04 02:17:38.099634 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:38.099600 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" event={"ID":"d6994b72-f668-44d8-ae8a-9d27011cea95","Type":"ContainerStarted","Data":"101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91"} Nov 04 02:17:38.099634 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:38.099640 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" event={"ID":"d6994b72-f668-44d8-ae8a-9d27011cea95","Type":"ContainerStarted","Data":"0900ef7902390d33711a1ee5389787157e7cb42970bda342940fb0fc1bf38487"} Nov 04 02:17:38.216404 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:38.216355 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" podStartSLOduration=2.216339633 podStartE2EDuration="2.216339633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:17:38.215327559 +0000 UTC m=+603.703836257" watchObservedRunningTime="2026-11-04 02:17:38.216339633 +0000 UTC m=+603.704848332" Nov 04 02:17:38.902805 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:38.902767 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:38.928429 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:17:38.928399 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:17:40.050148 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.050109 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k"] Nov 04 02:17:40.053638 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.053616 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.105931 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.105895 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-9adedd\"/\"openshift-service-ca.crt\"" Nov 04 02:17:40.128885 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.128855 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-tmp-dir\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.129042 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.128914 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-dshm\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.129042 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.128981 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh9t7\" (UniqueName: \"kubernetes.io/projected/2db863a6-cf81-4135-8941-277b1e5974ca-kube-api-access-zh9t7\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.129042 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.129010 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2db863a6-cf81-4135-8941-277b1e5974ca-tls-certs\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.129260 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.129110 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-model-cache\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.129260 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.129220 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-home\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.155510 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.155492 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-9adedd\"/\"kube-root-ca.crt\"" Nov 04 02:17:40.155595 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.155577 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-9adedd\"/\"default-dockercfg-jk7zs\"" Nov 04 02:17:40.155715 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.155697 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-9adedd\"/\"simulator-w6-9adedd-kserve-self-signed-certs\"" Nov 04 02:17:40.156793 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.156777 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k"] Nov 04 02:17:40.230093 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.230060 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-tmp-dir\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.230278 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.230115 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-dshm\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.230278 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.230143 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh9t7\" (UniqueName: \"kubernetes.io/projected/2db863a6-cf81-4135-8941-277b1e5974ca-kube-api-access-zh9t7\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.230278 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.230172 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2db863a6-cf81-4135-8941-277b1e5974ca-tls-certs\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.230278 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.230216 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-model-cache\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.230278 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.230262 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-home\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.230624 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.230597 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-tmp-dir\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.230733 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.230610 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-home\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.230733 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.230687 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-model-cache\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.232652 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.232629 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-dshm\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.232751 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.232719 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2db863a6-cf81-4135-8941-277b1e5974ca-tls-certs\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.294380 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.294351 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh9t7\" (UniqueName: \"kubernetes.io/projected/2db863a6-cf81-4135-8941-277b1e5974ca-kube-api-access-zh9t7\") pod \"simulator-w6-9adedd-kserve-76d7d6d898-8jj8k\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.365312 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.365199 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:40.615848 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.615765 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:17:40.766639 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:40.764740 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k"] Nov 04 02:17:40.771748 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:17:40.771714 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2db863a6_cf81_4135_8941_277b1e5974ca.slice/crio-ace944e21d1488cbb70e4e58b77910fb4dccf6c02346372e674a7f431dc5eee8 WatchSource:0}: Error finding container ace944e21d1488cbb70e4e58b77910fb4dccf6c02346372e674a7f431dc5eee8: Status 404 returned error can't find the container with id ace944e21d1488cbb70e4e58b77910fb4dccf6c02346372e674a7f431dc5eee8 Nov 04 02:17:41.114555 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:41.114520 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" event={"ID":"2db863a6-cf81-4135-8941-277b1e5974ca","Type":"ContainerStarted","Data":"ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876"} Nov 04 02:17:41.114555 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:41.114562 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" event={"ID":"2db863a6-cf81-4135-8941-277b1e5974ca","Type":"ContainerStarted","Data":"ace944e21d1488cbb70e4e58b77910fb4dccf6c02346372e674a7f431dc5eee8"} Nov 04 02:17:41.365655 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:41.365579 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:46.902813 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:46.902782 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:46.914745 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:46.914724 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:47.032698 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:47.032642 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" podStartSLOduration=7.032628433 podStartE2EDuration="7.032628433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:17:41.239701205 +0000 UTC m=+606.728209906" watchObservedRunningTime="2026-11-04 02:17:47.032628433 +0000 UTC m=+612.521137131" Nov 04 02:17:47.149227 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:47.149193 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:17:50.365740 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:50.365695 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:50.377881 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:50.377859 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:51.168546 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.168522 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:17:51.410013 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.409976 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m"] Nov 04 02:17:51.415704 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.415682 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.470867 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.470841 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-9b0f0d\"/\"kube-root-ca.crt\"" Nov 04 02:17:51.471067 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.470842 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-9b0f0d\"/\"openshift-service-ca.crt\"" Nov 04 02:17:51.471214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.471005 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-9b0f0d\"/\"default-dockercfg-hzptq\"" Nov 04 02:17:51.471214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.471103 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-9b0f0d\"/\"simulator-w2-9b0f0d-kserve-self-signed-certs\"" Nov 04 02:17:51.472438 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.472416 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m"] Nov 04 02:17:51.530805 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.530778 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-model-cache\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.530956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.530824 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-dshm\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.530956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.530900 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npvm2\" (UniqueName: \"kubernetes.io/projected/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-kube-api-access-npvm2\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.530956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.530944 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tmp-dir\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.531061 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.530966 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-home\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.531061 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.531038 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tls-certs\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.632261 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.632223 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-model-cache\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.632481 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.632305 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-dshm\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.632481 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.632339 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npvm2\" (UniqueName: \"kubernetes.io/projected/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-kube-api-access-npvm2\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.632481 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.632383 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tmp-dir\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.632481 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.632408 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-home\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.632481 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.632441 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tls-certs\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.632779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.632744 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-model-cache\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.632959 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.632824 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tmp-dir\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.633076 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.633002 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-home\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.634708 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.634684 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-dshm\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.635003 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.634987 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tls-certs\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.693420 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.693346 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npvm2\" (UniqueName: \"kubernetes.io/projected/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-kube-api-access-npvm2\") pod \"simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:51.727908 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:51.727857 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:52.103542 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:52.103469 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m"] Nov 04 02:17:52.106663 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:17:52.106639 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb7c28ed_2173_4c5a_9d7a_d5b8279768e0.slice/crio-d067a87a60a0d0a86bece402b9f215ad4b79e3b9d9ec59289926e7ac0f1c73fb WatchSource:0}: Error finding container d067a87a60a0d0a86bece402b9f215ad4b79e3b9d9ec59289926e7ac0f1c73fb: Status 404 returned error can't find the container with id d067a87a60a0d0a86bece402b9f215ad4b79e3b9d9ec59289926e7ac0f1c73fb Nov 04 02:17:52.161832 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:52.161804 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" event={"ID":"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0","Type":"ContainerStarted","Data":"04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b"} Nov 04 02:17:52.161951 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:52.161858 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" event={"ID":"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0","Type":"ContainerStarted","Data":"d067a87a60a0d0a86bece402b9f215ad4b79e3b9d9ec59289926e7ac0f1c73fb"} Nov 04 02:17:52.309159 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:52.304611 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" podStartSLOduration=1.304593139 podStartE2EDuration="1.304593139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:17:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:17:52.302183844 +0000 UTC m=+617.790692545" watchObservedRunningTime="2026-11-04 02:17:52.304593139 +0000 UTC m=+617.793101840" Nov 04 02:17:52.728513 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:52.728473 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:17:59.093351 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:17:59.093250 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:18:01.728262 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:01.728228 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:18:01.740452 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:01.740430 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:18:02.217749 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:02.217721 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:18:08.930886 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:18:08.930841 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:18:15.050856 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:15.050818 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:18:20.922214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:20.922172 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87"] Nov 04 02:18:20.926030 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:20.926008 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:20.987950 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:20.987921 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-5a27ba\"/\"default-dockercfg-dk4l4\"" Nov 04 02:18:21.000119 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.000090 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-5a27ba\"/\"simulator-w3-5a27ba-kserve-self-signed-certs\"" Nov 04 02:18:21.000440 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.000412 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-tmp-dir\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.000590 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.000478 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-home\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.000590 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.000521 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-model-cache\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.000590 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.000562 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15289361-0f0d-41ec-bbdc-5e15a53f901f-tls-certs\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.000768 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.000613 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-267tt\" (UniqueName: \"kubernetes.io/projected/15289361-0f0d-41ec-bbdc-5e15a53f901f-kube-api-access-267tt\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.000768 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.000633 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-dshm\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.027868 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.027845 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-5a27ba\"/\"kube-root-ca.crt\"" Nov 04 02:18:21.028003 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.027885 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-5a27ba\"/\"openshift-service-ca.crt\"" Nov 04 02:18:21.032706 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.032681 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87"] Nov 04 02:18:21.104313 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.101590 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-267tt\" (UniqueName: \"kubernetes.io/projected/15289361-0f0d-41ec-bbdc-5e15a53f901f-kube-api-access-267tt\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.104313 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.101648 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-dshm\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.104313 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.101715 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-tmp-dir\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.104313 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.101777 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-home\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.104313 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.101818 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-model-cache\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.104313 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.101863 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15289361-0f0d-41ec-bbdc-5e15a53f901f-tls-certs\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.105822 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.105794 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-tmp-dir\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.107233 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.106580 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-home\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.107486 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.107150 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-model-cache\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.109993 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.109971 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15289361-0f0d-41ec-bbdc-5e15a53f901f-tls-certs\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.110511 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.110451 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-dshm\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.167093 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.167067 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-267tt\" (UniqueName: \"kubernetes.io/projected/15289361-0f0d-41ec-bbdc-5e15a53f901f-kube-api-access-267tt\") pod \"simulator-w3-5a27ba-kserve-7796c6fd78-2hm87\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.237927 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.237890 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:21.622357 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:21.622257 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87"] Nov 04 02:18:21.625927 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:18:21.625892 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15289361_0f0d_41ec_bbdc_5e15a53f901f.slice/crio-9f3e7f54f9d8efbc349dd2f261ffb016ac7e68d0729494f50f8f97fc64edda01 WatchSource:0}: Error finding container 9f3e7f54f9d8efbc349dd2f261ffb016ac7e68d0729494f50f8f97fc64edda01: Status 404 returned error can't find the container with id 9f3e7f54f9d8efbc349dd2f261ffb016ac7e68d0729494f50f8f97fc64edda01 Nov 04 02:18:22.297696 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:22.297660 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" event={"ID":"15289361-0f0d-41ec-bbdc-5e15a53f901f","Type":"ContainerStarted","Data":"bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df"} Nov 04 02:18:22.298172 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:22.297704 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" event={"ID":"15289361-0f0d-41ec-bbdc-5e15a53f901f","Type":"ContainerStarted","Data":"9f3e7f54f9d8efbc349dd2f261ffb016ac7e68d0729494f50f8f97fc64edda01"} Nov 04 02:18:22.417853 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:22.417796 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" podStartSLOduration=2.41778159 podStartE2EDuration="2.41778159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:18:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:18:22.416973544 +0000 UTC m=+647.905482244" watchObservedRunningTime="2026-11-04 02:18:22.41778159 +0000 UTC m=+647.906290290" Nov 04 02:18:23.238900 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:23.238868 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:31.238545 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:31.238509 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:31.250730 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:31.250701 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:31.355468 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:31.355445 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:18:38.931890 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:18:38.931850 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:18:41.235730 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:41.235695 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:18:52.739474 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.739439 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr"] Nov 04 02:18:52.742890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.742874 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.794906 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.794886 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-5a27ba-openshift-default-dockercfg-r2gf6\"" Nov 04 02:18:52.797268 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.797234 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-certs\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.797413 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.797318 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-data\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.797480 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.797432 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istiod-ca-cert\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.797609 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.797591 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-envoy\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.797667 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.797626 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-token\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.797667 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.797646 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwp9b\" (UniqueName: \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-kube-api-access-qwp9b\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.797746 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.797684 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-credential-socket\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.797746 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.797730 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-socket\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.797746 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.797745 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-podinfo\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.845934 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.845909 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr"] Nov 04 02:18:52.899918 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.899646 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-envoy\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.899918 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.899722 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-token\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.900485 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.900307 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwp9b\" (UniqueName: \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-kube-api-access-qwp9b\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.900485 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.900384 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-credential-socket\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.900485 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.900420 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-socket\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.900485 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.900449 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-podinfo\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.903576 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.902351 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-certs\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.903576 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.902400 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-data\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.903576 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.902441 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istiod-ca-cert\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.903576 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.903267 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-certs\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.903576 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.903354 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-data\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.903576 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.903373 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-socket\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.903576 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.903529 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istiod-ca-cert\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.904179 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.903743 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-credential-socket\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.905355 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.905332 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-envoy\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.905658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.905642 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-podinfo\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.966631 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.966564 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-token\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:52.968384 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:52.968324 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwp9b\" (UniqueName: \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-kube-api-access-qwp9b\") pod \"e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:53.055334 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:53.055228 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:53.491352 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:53.491325 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr"] Nov 04 02:18:53.494610 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:18:53.494581 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f542f33_eb42_4bff_a4e4_51a9c87a6265.slice/crio-186dcad669814c438461b86b42ac41ef116aa5516177edff3359bc3335345569 WatchSource:0}: Error finding container 186dcad669814c438461b86b42ac41ef116aa5516177edff3359bc3335345569: Status 404 returned error can't find the container with id 186dcad669814c438461b86b42ac41ef116aa5516177edff3359bc3335345569 Nov 04 02:18:53.496852 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:53.496813 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:18:53.496991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:53.496900 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:18:53.496991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:53.496948 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:18:53.932318 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:53.932253 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69"] Nov 04 02:18:53.936497 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:53.936470 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.020823 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.020787 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bef561c-0f3e-4b13-ac09-d70853b38226-istiod-ca-cert\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.021171 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.021145 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-data\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.021416 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.021395 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-certs\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.021610 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.021592 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.021812 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.021796 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-envoy\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.021977 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.021960 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-credential-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.022133 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.022118 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-podinfo\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.022311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.022272 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mknbm\" (UniqueName: \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-kube-api-access-mknbm\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.022490 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.022474 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-token\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.049890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.049844 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-e34b54-openshift-default-dockercfg-vpxtz\"" Nov 04 02:18:54.050175 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.050128 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69"] Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.123788 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-data\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.123841 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-certs\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.123879 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.123931 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-envoy\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.123958 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-credential-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.123988 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-podinfo\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.124034 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mknbm\" (UniqueName: \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-kube-api-access-mknbm\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.124077 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-token\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.124142 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bef561c-0f3e-4b13-ac09-d70853b38226-istiod-ca-cert\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.124941 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bef561c-0f3e-4b13-ac09-d70853b38226-istiod-ca-cert\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.125211 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-data\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.125455 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-certs\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.125663 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.130311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.126529 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-credential-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.138309 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.136738 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-envoy\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.148311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.147196 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-podinfo\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.188020 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.187951 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-token\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.188020 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.187965 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mknbm\" (UniqueName: \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-kube-api-access-mknbm\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.259631 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.259600 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:54.451435 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.451330 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" event={"ID":"0f542f33-eb42-4bff-a4e4-51a9c87a6265","Type":"ContainerStarted","Data":"92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de"} Nov 04 02:18:54.451435 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.451393 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" event={"ID":"0f542f33-eb42-4bff-a4e4-51a9c87a6265","Type":"ContainerStarted","Data":"186dcad669814c438461b86b42ac41ef116aa5516177edff3359bc3335345569"} Nov 04 02:18:54.574260 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.574157 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" podStartSLOduration=2.574143315 podStartE2EDuration="2.574143315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:18:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:18:54.57338005 +0000 UTC m=+680.061888750" watchObservedRunningTime="2026-11-04 02:18:54.574143315 +0000 UTC m=+680.062652015" Nov 04 02:18:54.751480 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.751444 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69"] Nov 04 02:18:54.753431 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:18:54.753403 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bef561c_0f3e_4b13_ac09_d70853b38226.slice/crio-c6547c8a48b13dae764d852520188cf3914cfee831dfbe7fae518bff7b61f4d4 WatchSource:0}: Error finding container c6547c8a48b13dae764d852520188cf3914cfee831dfbe7fae518bff7b61f4d4: Status 404 returned error can't find the container with id c6547c8a48b13dae764d852520188cf3914cfee831dfbe7fae518bff7b61f4d4 Nov 04 02:18:54.755825 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.755792 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:18:54.755919 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.755854 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:18:54.755919 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:54.755882 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:18:55.055805 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:55.055705 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:18:55.057604 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:55.057576 5219 patch_prober.go:29] interesting pod/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 02:18:55.057737 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:55.057624 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" podUID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 02:18:55.506476 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:55.506445 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" event={"ID":"5bef561c-0f3e-4b13-ac09-d70853b38226","Type":"ContainerStarted","Data":"791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe"} Nov 04 02:18:55.506744 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:55.506726 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" event={"ID":"5bef561c-0f3e-4b13-ac09-d70853b38226","Type":"ContainerStarted","Data":"c6547c8a48b13dae764d852520188cf3914cfee831dfbe7fae518bff7b61f4d4"} Nov 04 02:18:55.631314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:55.630919 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" podStartSLOduration=2.630898476 podStartE2EDuration="2.630898476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:18:55.628791768 +0000 UTC m=+681.117300470" watchObservedRunningTime="2026-11-04 02:18:55.630898476 +0000 UTC m=+681.119407176" Nov 04 02:18:56.058311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:56.057720 5219 patch_prober.go:29] interesting pod/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 02:18:56.058311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:56.057785 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" podUID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 02:18:56.266205 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:56.266154 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:18:56.266438 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:56.266312 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Nov 04 02:18:56.266438 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:56.266362 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" podUID="5bef561c-0f3e-4b13-ac09-d70853b38226" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Nov 04 02:18:57.062166 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:57.061700 5219 patch_prober.go:29] interesting pod/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 02:18:57.062166 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:57.061765 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" podUID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 02:18:57.260553 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:57.260507 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Nov 04 02:18:57.260873 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:57.260832 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" podUID="5bef561c-0f3e-4b13-ac09-d70853b38226" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Nov 04 02:18:58.061733 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:58.061695 5219 patch_prober.go:29] interesting pod/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 02:18:58.062032 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:58.061998 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" podUID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 02:18:58.265053 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:58.264623 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Nov 04 02:18:58.265053 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:58.264685 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" podUID="5bef561c-0f3e-4b13-ac09-d70853b38226" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Nov 04 02:18:59.058310 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:59.057803 5219 patch_prober.go:29] interesting pod/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 02:18:59.058310 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:59.057879 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" podUID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 02:18:59.262194 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:59.262151 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:18:59.262408 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:59.262384 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Nov 04 02:18:59.262507 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:18:59.262441 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" podUID="5bef561c-0f3e-4b13-ac09-d70853b38226" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Nov 04 02:19:00.060780 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:19:00.060752 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:19:00.061274 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:19:00.061201 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:19:00.061930 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:19:00.061913 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:19:00.260725 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:19:00.260691 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Nov 04 02:19:00.260895 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:19:00.260743 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" podUID="5bef561c-0f3e-4b13-ac09-d70853b38226" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Nov 04 02:19:02.158915 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:19:02.158883 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:19:02.159981 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:19:02.159954 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:19:02.160927 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:19:02.160903 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:19:08.929429 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:19:08.929391 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:19:34.499988 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:19:34.499912 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:19:38.930445 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:19:38.930405 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:19:54.767466 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:19:54.767431 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:20:08.928952 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:20:08.928917 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:20:20.139425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:20.139386 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:20:35.682344 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.682304 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh"] Nov 04 02:20:35.685089 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.685073 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.700762 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.700743 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-dshm\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.700856 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.700792 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjdbl\" (UniqueName: \"kubernetes.io/projected/9d1de1f7-344c-4460-97aa-0c3bece4f57a-kube-api-access-hjdbl\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.700913 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.700899 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tmp-dir\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.700978 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.700966 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-home\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.701012 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.700986 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tls-certs\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.701088 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.701077 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-model-cache\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.786848 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.786820 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e34b54\"/\"distinct-w0-e34b54-kserve-self-signed-certs\"" Nov 04 02:20:35.788075 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.788055 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh"] Nov 04 02:20:35.801857 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.801833 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-model-cache\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.801983 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.801870 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-dshm\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.802039 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.801997 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjdbl\" (UniqueName: \"kubernetes.io/projected/9d1de1f7-344c-4460-97aa-0c3bece4f57a-kube-api-access-hjdbl\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.802093 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.802060 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tmp-dir\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.802148 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.802108 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-home\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.802148 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.802127 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tls-certs\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.802351 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.802334 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-model-cache\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.802426 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.802394 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tmp-dir\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.802520 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.802499 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-home\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.804282 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.804263 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-dshm\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.804598 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.804584 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tls-certs\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.865927 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.865899 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjdbl\" (UniqueName: \"kubernetes.io/projected/9d1de1f7-344c-4460-97aa-0c3bece4f57a-kube-api-access-hjdbl\") pod \"distinct-w0-e34b54-kserve-76d54d79d6-826rh\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:35.995752 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:35.995663 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:36.386512 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:36.386441 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh"] Nov 04 02:20:36.389851 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:20:36.389829 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d1de1f7_344c_4460_97aa_0c3bece4f57a.slice/crio-36f6f5cca8af193f8f6693d97f0b88618512ade490e9b814cfadfeeb0e31971b WatchSource:0}: Error finding container 36f6f5cca8af193f8f6693d97f0b88618512ade490e9b814cfadfeeb0e31971b: Status 404 returned error can't find the container with id 36f6f5cca8af193f8f6693d97f0b88618512ade490e9b814cfadfeeb0e31971b Nov 04 02:20:36.993664 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:36.993626 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" event={"ID":"9d1de1f7-344c-4460-97aa-0c3bece4f57a","Type":"ContainerStarted","Data":"113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67"} Nov 04 02:20:36.993664 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:36.993678 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" event={"ID":"9d1de1f7-344c-4460-97aa-0c3bece4f57a","Type":"ContainerStarted","Data":"36f6f5cca8af193f8f6693d97f0b88618512ade490e9b814cfadfeeb0e31971b"} Nov 04 02:20:36.995912 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:36.995893 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:37.113073 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:37.113012 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" podStartSLOduration=2.112992354 podStartE2EDuration="2.112992354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:20:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:37.110600779 +0000 UTC m=+782.599109495" watchObservedRunningTime="2026-11-04 02:20:37.112992354 +0000 UTC m=+782.601501054" Nov 04 02:20:38.953522 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:20:38.952689 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:20:45.996168 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:45.996138 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:46.008282 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:46.008254 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:46.044716 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:46.044690 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:20:55.268855 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.268823 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf"] Nov 04 02:20:55.271859 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.271843 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.290701 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.290675 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:20:55.324583 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.324558 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-8cf267-openshift-default-dockercfg-7jsf4\"" Nov 04 02:20:55.372922 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.372891 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf"] Nov 04 02:20:55.402497 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.402438 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f8a844c-2007-42cc-b274-dab96d24e8bd-istiod-ca-cert\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.402497 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.402472 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-podinfo\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.402668 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.402573 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-socket\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.402668 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.402653 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-envoy\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.402783 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.402686 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r62d\" (UniqueName: \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-kube-api-access-9r62d\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.402783 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.402769 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-data\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.402894 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.402792 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-certs\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.402894 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.402886 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-token\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.402993 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.402955 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-credential-socket\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.504670 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.504365 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f8a844c-2007-42cc-b274-dab96d24e8bd-istiod-ca-cert\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.504670 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.504425 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-podinfo\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.504670 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.504481 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-socket\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.504670 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.504524 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-envoy\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.504670 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.504567 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r62d\" (UniqueName: \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-kube-api-access-9r62d\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.504670 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.504609 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-data\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.505134 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.504996 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-certs\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.505134 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.505052 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-token\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.505134 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.505109 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-credential-socket\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.505318 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.505260 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f8a844c-2007-42cc-b274-dab96d24e8bd-istiod-ca-cert\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.505652 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.505522 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-credential-socket\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.505652 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.505571 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-data\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.505828 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.505643 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-certs\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.505828 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.505771 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-socket\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.507981 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.507934 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-envoy\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.508656 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.508627 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-podinfo\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.565676 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.565617 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r62d\" (UniqueName: \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-kube-api-access-9r62d\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.565676 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.565631 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-token\") pod \"e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:55.617038 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:55.617016 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:56.071365 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:56.071332 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf"] Nov 04 02:20:56.074405 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:20:56.074378 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8a844c_2007_42cc_b274_dab96d24e8bd.slice/crio-00ebaba4c22fb65cec12cbfb9cca95b5ce211cc81a8d6a363a1e63e36cd787d5 WatchSource:0}: Error finding container 00ebaba4c22fb65cec12cbfb9cca95b5ce211cc81a8d6a363a1e63e36cd787d5: Status 404 returned error can't find the container with id 00ebaba4c22fb65cec12cbfb9cca95b5ce211cc81a8d6a363a1e63e36cd787d5 Nov 04 02:20:56.076779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:56.076751 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:20:56.076840 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:56.076809 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:20:56.076840 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:56.076837 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:20:57.082952 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:57.082906 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" event={"ID":"5f8a844c-2007-42cc-b274-dab96d24e8bd","Type":"ContainerStarted","Data":"52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2"} Nov 04 02:20:57.083458 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:57.083008 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" event={"ID":"5f8a844c-2007-42cc-b274-dab96d24e8bd","Type":"ContainerStarted","Data":"00ebaba4c22fb65cec12cbfb9cca95b5ce211cc81a8d6a363a1e63e36cd787d5"} Nov 04 02:20:57.304404 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:57.304345 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" podStartSLOduration=2.3043331 podStartE2EDuration="2.3043331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:57.254677603 +0000 UTC m=+802.743186318" watchObservedRunningTime="2026-11-04 02:20:57.3043331 +0000 UTC m=+802.792841803" Nov 04 02:20:57.621636 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:57.621607 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:20:57.640501 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:57.640464 5219 patch_prober.go:29] interesting pod/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Nov 04 02:20:57.640665 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:57.640534 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Nov 04 02:20:58.624323 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:58.623644 5219 patch_prober.go:29] interesting pod/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Nov 04 02:20:58.624323 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:58.623702 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Nov 04 02:20:59.640358 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:59.627670 5219 patch_prober.go:29] interesting pod/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Nov 04 02:20:59.640358 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:20:59.627733 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Nov 04 02:21:00.617720 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:00.617630 5219 patch_prober.go:29] interesting pod/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Nov 04 02:21:00.617997 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:00.617971 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Nov 04 02:21:01.630809 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:01.630765 5219 patch_prober.go:29] interesting pod/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Nov 04 02:21:01.631437 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:01.631401 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Nov 04 02:21:02.674726 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:02.674696 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:21:02.675524 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:02.675505 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:21:02.676429 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:02.676411 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:21:08.929746 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:21:08.929710 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:21:23.184106 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.184073 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm"] Nov 04 02:21:23.187368 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.187343 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.288744 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.288717 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-9adedd\"/\"distinct-w6-9adedd-kserve-self-signed-certs\"" Nov 04 02:21:23.290152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.290132 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm"] Nov 04 02:21:23.292033 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.292016 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cadf750-853e-48ef-8e72-fd6665a740dd-tls-certs\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.292084 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.292046 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-tmp-dir\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.292084 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.292077 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz8bk\" (UniqueName: \"kubernetes.io/projected/5cadf750-853e-48ef-8e72-fd6665a740dd-kube-api-access-xz8bk\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.292182 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.292170 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-home\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.292219 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.292195 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-model-cache\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.292322 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.292222 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-dshm\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.393102 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.393070 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cadf750-853e-48ef-8e72-fd6665a740dd-tls-certs\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.393102 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.393106 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-tmp-dir\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.393388 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.393142 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz8bk\" (UniqueName: \"kubernetes.io/projected/5cadf750-853e-48ef-8e72-fd6665a740dd-kube-api-access-xz8bk\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.393388 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.393166 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-home\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.393388 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.393187 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-model-cache\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.393388 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.393272 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-dshm\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.393640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.393616 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-home\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.393707 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.393676 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-model-cache\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.393794 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.393766 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-tmp-dir\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.395704 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.395676 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-dshm\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.396097 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.396074 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cadf750-853e-48ef-8e72-fd6665a740dd-tls-certs\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.462063 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.461999 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz8bk\" (UniqueName: \"kubernetes.io/projected/5cadf750-853e-48ef-8e72-fd6665a740dd-kube-api-access-xz8bk\") pod \"distinct-w6-9adedd-kserve-595cdf8694-lnghm\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.498694 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.498658 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:23.915815 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:23.915739 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm"] Nov 04 02:21:23.918704 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:21:23.918674 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cadf750_853e_48ef_8e72_fd6665a740dd.slice/crio-757e22de47c2a15a82071f8308b19c19bf76d9e8b3af80ae92b4da4e511e849a WatchSource:0}: Error finding container 757e22de47c2a15a82071f8308b19c19bf76d9e8b3af80ae92b4da4e511e849a: Status 404 returned error can't find the container with id 757e22de47c2a15a82071f8308b19c19bf76d9e8b3af80ae92b4da4e511e849a Nov 04 02:21:24.205512 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:24.205486 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" event={"ID":"5cadf750-853e-48ef-8e72-fd6665a740dd","Type":"ContainerStarted","Data":"1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9"} Nov 04 02:21:24.205891 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:24.205520 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" event={"ID":"5cadf750-853e-48ef-8e72-fd6665a740dd","Type":"ContainerStarted","Data":"757e22de47c2a15a82071f8308b19c19bf76d9e8b3af80ae92b4da4e511e849a"} Nov 04 02:21:24.322114 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:24.322072 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" podStartSLOduration=1.322057535 podStartE2EDuration="1.322057535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:24.320685826 +0000 UTC m=+829.809194529" watchObservedRunningTime="2026-11-04 02:21:24.322057535 +0000 UTC m=+829.810566234" Nov 04 02:21:24.499586 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:24.499512 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:25.163027 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.163000 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4"] Nov 04 02:21:25.166340 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.166317 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.210061 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.210033 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq75v\" (UniqueName: \"kubernetes.io/projected/b58a393b-139e-4d5f-b396-5f8af95f5990-kube-api-access-dq75v\") pod \"maas-api-revoke-sub-2280dcfc-hrqc4\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.210437 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.210087 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2280dcfc-hrqc4\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.210437 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.210125 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2280dcfc-hrqc4\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.267715 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.267689 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 02:21:25.267830 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.267721 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bvs2z\"" Nov 04 02:21:25.269411 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.269393 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4"] Nov 04 02:21:25.310974 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.310947 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq75v\" (UniqueName: \"kubernetes.io/projected/b58a393b-139e-4d5f-b396-5f8af95f5990-kube-api-access-dq75v\") pod \"maas-api-revoke-sub-2280dcfc-hrqc4\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.311064 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.311013 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2280dcfc-hrqc4\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.311064 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.311050 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2280dcfc-hrqc4\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.311721 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.311704 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2280dcfc-hrqc4\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.313455 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.313434 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2280dcfc-hrqc4\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.371481 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.371456 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq75v\" (UniqueName: \"kubernetes.io/projected/b58a393b-139e-4d5f-b396-5f8af95f5990-kube-api-access-dq75v\") pod \"maas-api-revoke-sub-2280dcfc-hrqc4\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.479480 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.479458 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:25.851337 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.851258 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4"] Nov 04 02:21:25.854324 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:21:25.854279 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58a393b_139e_4d5f_b396_5f8af95f5990.slice/crio-30a59dac9ba846cc1c985f1c4ad3c102ffa7d9a2373d37c17f02926ecf34e3c5 WatchSource:0}: Error finding container 30a59dac9ba846cc1c985f1c4ad3c102ffa7d9a2373d37c17f02926ecf34e3c5: Status 404 returned error can't find the container with id 30a59dac9ba846cc1c985f1c4ad3c102ffa7d9a2373d37c17f02926ecf34e3c5 Nov 04 02:21:25.856337 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:25.856315 5219 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 02:21:26.216046 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:26.216019 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" event={"ID":"b58a393b-139e-4d5f-b396-5f8af95f5990","Type":"ContainerStarted","Data":"30a59dac9ba846cc1c985f1c4ad3c102ffa7d9a2373d37c17f02926ecf34e3c5"} Nov 04 02:21:29.513491 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.513452 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m"] Nov 04 02:21:29.637558 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.637525 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f"] Nov 04 02:21:29.641357 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.641342 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:29.644943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.644915 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9709d391-k8q6f\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:29.645074 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.645058 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9709d391-k8q6f\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:29.645155 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.645141 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnwv7\" (UniqueName: \"kubernetes.io/projected/267f7d43-7ff8-400b-add9-171b9dc562ca-kube-api-access-hnwv7\") pod \"maas-api-revoke-sub-9709d391-k8q6f\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:29.726674 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.726649 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f"] Nov 04 02:21:29.746097 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.746071 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9709d391-k8q6f\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:29.746232 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.746142 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9709d391-k8q6f\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:29.746232 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.746166 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnwv7\" (UniqueName: \"kubernetes.io/projected/267f7d43-7ff8-400b-add9-171b9dc562ca-kube-api-access-hnwv7\") pod \"maas-api-revoke-sub-9709d391-k8q6f\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:29.746930 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.746905 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9709d391-k8q6f\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:29.748674 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.748646 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9709d391-k8q6f\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:29.807643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.807584 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnwv7\" (UniqueName: \"kubernetes.io/projected/267f7d43-7ff8-400b-add9-171b9dc562ca-kube-api-access-hnwv7\") pod \"maas-api-revoke-sub-9709d391-k8q6f\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:29.955445 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:29.955421 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:30.339053 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:30.339016 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f"] Nov 04 02:21:30.341666 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:21:30.341616 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267f7d43_7ff8_400b_add9_171b9dc562ca.slice/crio-564b76c46f516ae423cf0ed2d815f1f8c173086d0f6baacdb1837abdd36cc2ef WatchSource:0}: Error finding container 564b76c46f516ae423cf0ed2d815f1f8c173086d0f6baacdb1837abdd36cc2ef: Status 404 returned error can't find the container with id 564b76c46f516ae423cf0ed2d815f1f8c173086d0f6baacdb1837abdd36cc2ef Nov 04 02:21:31.241612 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:31.241571 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" event={"ID":"b58a393b-139e-4d5f-b396-5f8af95f5990","Type":"ContainerStarted","Data":"cc0969fb45f88f3369bacb0f426ac384be721932f4c187601a574b254925d609"} Nov 04 02:21:31.242946 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:31.242923 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" event={"ID":"267f7d43-7ff8-400b-add9-171b9dc562ca","Type":"ContainerStarted","Data":"564b76c46f516ae423cf0ed2d815f1f8c173086d0f6baacdb1837abdd36cc2ef"} Nov 04 02:21:31.361142 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:31.361085 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" podStartSLOduration=1.3323735270000001 podStartE2EDuration="6.361066557s" totalImagesPullingTime="5.02869303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:31.359953394 +0000 UTC m=+836.848462094" watchObservedRunningTime="2026-11-04 02:21:31.361066557 +0000 UTC m=+836.849575263" Nov 04 02:21:32.248637 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.248605 5219 generic.go:356] "Generic (PLEG): container finished" podID="b58a393b-139e-4d5f-b396-5f8af95f5990" containerID="cc0969fb45f88f3369bacb0f426ac384be721932f4c187601a574b254925d609" exitCode=0 Nov 04 02:21:32.248973 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.248698 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" event={"ID":"b58a393b-139e-4d5f-b396-5f8af95f5990","Type":"ContainerDied","Data":"cc0969fb45f88f3369bacb0f426ac384be721932f4c187601a574b254925d609"} Nov 04 02:21:32.675143 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.675114 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6"] Nov 04 02:21:32.683634 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.683605 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:32.736404 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.736365 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6"] Nov 04 02:21:32.780406 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.780375 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-69360ac7-s5xt6\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:32.780572 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.780419 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tlbk\" (UniqueName: \"kubernetes.io/projected/7328bed0-6437-4d3e-a65c-73e3e09a33e5-kube-api-access-4tlbk\") pod \"maas-api-revoke-sub-69360ac7-s5xt6\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:32.780572 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.780510 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-69360ac7-s5xt6\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:32.882027 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.881995 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-69360ac7-s5xt6\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:32.882204 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.882093 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-69360ac7-s5xt6\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:32.882204 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.882121 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tlbk\" (UniqueName: \"kubernetes.io/projected/7328bed0-6437-4d3e-a65c-73e3e09a33e5-kube-api-access-4tlbk\") pod \"maas-api-revoke-sub-69360ac7-s5xt6\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:32.882681 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.882656 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-69360ac7-s5xt6\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:32.884942 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.884921 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-69360ac7-s5xt6\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:32.942992 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.942925 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tlbk\" (UniqueName: \"kubernetes.io/projected/7328bed0-6437-4d3e-a65c-73e3e09a33e5-kube-api-access-4tlbk\") pod \"maas-api-revoke-sub-69360ac7-s5xt6\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:32.995452 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:32.995422 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:33.255055 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.254970 5219 generic.go:356] "Generic (PLEG): container finished" podID="267f7d43-7ff8-400b-add9-171b9dc562ca" containerID="656f93a427b28c293604e4195513153a0e55f1dbc2241d3370a9069bfbba4602" exitCode=0 Nov 04 02:21:33.255460 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.255056 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" event={"ID":"267f7d43-7ff8-400b-add9-171b9dc562ca","Type":"ContainerDied","Data":"656f93a427b28c293604e4195513153a0e55f1dbc2241d3370a9069bfbba4602"} Nov 04 02:21:33.393772 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.385411 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6"] Nov 04 02:21:33.393772 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:21:33.393606 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7328bed0_6437_4d3e_a65c_73e3e09a33e5.slice/crio-f49d0d8dd9784913924285a2d01ecde536a43810a522e6310531e6cb63915555 WatchSource:0}: Error finding container f49d0d8dd9784913924285a2d01ecde536a43810a522e6310531e6cb63915555: Status 404 returned error can't find the container with id f49d0d8dd9784913924285a2d01ecde536a43810a522e6310531e6cb63915555 Nov 04 02:21:33.490227 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.490204 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:33.499031 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.499007 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:33.511037 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.510973 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:33.586924 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.586890 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b58a393b-139e-4d5f-b396-5f8af95f5990-kube-api-access-dq75v\" (UniqueName: \"kubernetes.io/projected/b58a393b-139e-4d5f-b396-5f8af95f5990-kube-api-access-dq75v\") pod \"b58a393b-139e-4d5f-b396-5f8af95f5990\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " Nov 04 02:21:33.586924 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.586921 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-openshift-ca\") pod \"b58a393b-139e-4d5f-b396-5f8af95f5990\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " Nov 04 02:21:33.587123 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.586983 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-xks-ca\") pod \"b58a393b-139e-4d5f-b396-5f8af95f5990\" (UID: \"b58a393b-139e-4d5f-b396-5f8af95f5990\") " Nov 04 02:21:33.587389 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.587359 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-openshift-ca" pod "b58a393b-139e-4d5f-b396-5f8af95f5990" (UID: "b58a393b-139e-4d5f-b396-5f8af95f5990"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:21:33.587521 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.587467 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-openshift-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:33.589267 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.589247 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-xks-ca" pod "b58a393b-139e-4d5f-b396-5f8af95f5990" (UID: "b58a393b-139e-4d5f-b396-5f8af95f5990"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:21:33.589351 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.589323 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58a393b-139e-4d5f-b396-5f8af95f5990-kube-api-access-dq75v" pod "b58a393b-139e-4d5f-b396-5f8af95f5990" (UID: "b58a393b-139e-4d5f-b396-5f8af95f5990"). InnerVolumeSpecName "kube-api-access-dq75v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:33.683525 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.683490 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:21:33.688387 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.688369 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq75v\" (UniqueName: \"kubernetes.io/projected/b58a393b-139e-4d5f-b396-5f8af95f5990-kube-api-access-dq75v\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:33.688504 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:33.688388 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b58a393b-139e-4d5f-b396-5f8af95f5990-maas-api-xks-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:34.279309 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.270785 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" event={"ID":"b58a393b-139e-4d5f-b396-5f8af95f5990","Type":"ContainerDied","Data":"30a59dac9ba846cc1c985f1c4ad3c102ffa7d9a2373d37c17f02926ecf34e3c5"} Nov 04 02:21:34.279309 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.270850 5219 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30a59dac9ba846cc1c985f1c4ad3c102ffa7d9a2373d37c17f02926ecf34e3c5" Nov 04 02:21:34.279309 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.270926 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4" Nov 04 02:21:34.285048 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.284976 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" event={"ID":"7328bed0-6437-4d3e-a65c-73e3e09a33e5","Type":"ContainerStarted","Data":"16471ce1ab55909ea1d42553241695e4b90c28c9276c2b4f5ac1f70e08207d00"} Nov 04 02:21:34.285326 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.285280 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" event={"ID":"7328bed0-6437-4d3e-a65c-73e3e09a33e5","Type":"ContainerStarted","Data":"f49d0d8dd9784913924285a2d01ecde536a43810a522e6310531e6cb63915555"} Nov 04 02:21:34.299982 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.299963 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:21:34.402407 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.402362 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" podStartSLOduration=2.402346512 podStartE2EDuration="2.402346512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:34.401638266 +0000 UTC m=+839.890146968" watchObservedRunningTime="2026-11-04 02:21:34.402346512 +0000 UTC m=+839.890855212" Nov 04 02:21:34.455937 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.455916 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:34.496188 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.496168 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-openshift-ca\") pod \"267f7d43-7ff8-400b-add9-171b9dc562ca\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " Nov 04 02:21:34.496283 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.496214 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/267f7d43-7ff8-400b-add9-171b9dc562ca-kube-api-access-hnwv7\" (UniqueName: \"kubernetes.io/projected/267f7d43-7ff8-400b-add9-171b9dc562ca-kube-api-access-hnwv7\") pod \"267f7d43-7ff8-400b-add9-171b9dc562ca\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " Nov 04 02:21:34.496347 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.496336 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-xks-ca\") pod \"267f7d43-7ff8-400b-add9-171b9dc562ca\" (UID: \"267f7d43-7ff8-400b-add9-171b9dc562ca\") " Nov 04 02:21:34.496572 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.496540 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-openshift-ca" pod "267f7d43-7ff8-400b-add9-171b9dc562ca" (UID: "267f7d43-7ff8-400b-add9-171b9dc562ca"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:21:34.498332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.498309 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-xks-ca" pod "267f7d43-7ff8-400b-add9-171b9dc562ca" (UID: "267f7d43-7ff8-400b-add9-171b9dc562ca"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:21:34.498407 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.498392 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267f7d43-7ff8-400b-add9-171b9dc562ca-kube-api-access-hnwv7" pod "267f7d43-7ff8-400b-add9-171b9dc562ca" (UID: "267f7d43-7ff8-400b-add9-171b9dc562ca"). InnerVolumeSpecName "kube-api-access-hnwv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:34.597857 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.597826 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-openshift-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:34.597857 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.597847 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnwv7\" (UniqueName: \"kubernetes.io/projected/267f7d43-7ff8-400b-add9-171b9dc562ca-kube-api-access-hnwv7\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:34.597857 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:34.597857 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/267f7d43-7ff8-400b-add9-171b9dc562ca-maas-api-xks-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:35.233790 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:35.233762 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87"] Nov 04 02:21:35.282999 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:35.282962 5219 generic.go:356] "Generic (PLEG): container finished" podID="7328bed0-6437-4d3e-a65c-73e3e09a33e5" containerID="16471ce1ab55909ea1d42553241695e4b90c28c9276c2b4f5ac1f70e08207d00" exitCode=0 Nov 04 02:21:35.283443 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:35.283041 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" event={"ID":"7328bed0-6437-4d3e-a65c-73e3e09a33e5","Type":"ContainerDied","Data":"16471ce1ab55909ea1d42553241695e4b90c28c9276c2b4f5ac1f70e08207d00"} Nov 04 02:21:35.284394 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:35.284356 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" event={"ID":"267f7d43-7ff8-400b-add9-171b9dc562ca","Type":"ContainerDied","Data":"564b76c46f516ae423cf0ed2d815f1f8c173086d0f6baacdb1837abdd36cc2ef"} Nov 04 02:21:35.284541 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:35.284407 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f" Nov 04 02:21:35.284541 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:35.284417 5219 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="564b76c46f516ae423cf0ed2d815f1f8c173086d0f6baacdb1837abdd36cc2ef" Nov 04 02:21:36.427624 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:36.427600 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:36.522250 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:36.522225 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-xks-ca\") pod \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " Nov 04 02:21:36.522397 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:36.522334 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-openshift-ca\") pod \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " Nov 04 02:21:36.522397 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:36.522382 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7328bed0-6437-4d3e-a65c-73e3e09a33e5-kube-api-access-4tlbk\" (UniqueName: \"kubernetes.io/projected/7328bed0-6437-4d3e-a65c-73e3e09a33e5-kube-api-access-4tlbk\") pod \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\" (UID: \"7328bed0-6437-4d3e-a65c-73e3e09a33e5\") " Nov 04 02:21:36.522667 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:36.522646 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-openshift-ca" pod "7328bed0-6437-4d3e-a65c-73e3e09a33e5" (UID: "7328bed0-6437-4d3e-a65c-73e3e09a33e5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:21:36.524458 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:36.524435 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-xks-ca" pod "7328bed0-6437-4d3e-a65c-73e3e09a33e5" (UID: "7328bed0-6437-4d3e-a65c-73e3e09a33e5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:21:36.524458 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:36.524449 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7328bed0-6437-4d3e-a65c-73e3e09a33e5-kube-api-access-4tlbk" pod "7328bed0-6437-4d3e-a65c-73e3e09a33e5" (UID: "7328bed0-6437-4d3e-a65c-73e3e09a33e5"). InnerVolumeSpecName "kube-api-access-4tlbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:36.623997 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:36.623974 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-xks-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:36.624073 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:36.624003 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7328bed0-6437-4d3e-a65c-73e3e09a33e5-maas-api-openshift-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:36.624073 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:36.624017 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tlbk\" (UniqueName: \"kubernetes.io/projected/7328bed0-6437-4d3e-a65c-73e3e09a33e5-kube-api-access-4tlbk\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:37.297045 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:37.297021 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" Nov 04 02:21:37.297210 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:37.297017 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6" event={"ID":"7328bed0-6437-4d3e-a65c-73e3e09a33e5","Type":"ContainerDied","Data":"f49d0d8dd9784913924285a2d01ecde536a43810a522e6310531e6cb63915555"} Nov 04 02:21:37.297210 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:37.297128 5219 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f49d0d8dd9784913924285a2d01ecde536a43810a522e6310531e6cb63915555" Nov 04 02:21:38.929251 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:21:38.929207 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:21:41.748766 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.748735 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf"] Nov 04 02:21:41.749216 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.749100 5219 cpu_manager.go:414] "containerMap: removing container" podUID="b58a393b-139e-4d5f-b396-5f8af95f5990" containerName="revoke-keys" Nov 04 02:21:41.749216 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.749110 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b58a393b-139e-4d5f-b396-5f8af95f5990" containerName="revoke-keys" Nov 04 02:21:41.749216 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.749134 5219 cpu_manager.go:414] "containerMap: removing container" podUID="7328bed0-6437-4d3e-a65c-73e3e09a33e5" containerName="revoke-keys" Nov 04 02:21:41.749216 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.749138 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7328bed0-6437-4d3e-a65c-73e3e09a33e5" containerName="revoke-keys" Nov 04 02:21:41.749216 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.749152 5219 cpu_manager.go:414] "containerMap: removing container" podUID="267f7d43-7ff8-400b-add9-171b9dc562ca" containerName="revoke-keys" Nov 04 02:21:41.749216 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.749157 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="267f7d43-7ff8-400b-add9-171b9dc562ca" containerName="revoke-keys" Nov 04 02:21:41.749216 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.749220 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="7328bed0-6437-4d3e-a65c-73e3e09a33e5" containerName="revoke-keys" Nov 04 02:21:41.749455 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.749230 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="267f7d43-7ff8-400b-add9-171b9dc562ca" containerName="revoke-keys" Nov 04 02:21:41.749455 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.749245 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="b58a393b-139e-4d5f-b396-5f8af95f5990" containerName="revoke-keys" Nov 04 02:21:41.752480 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.752466 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:41.804531 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.804509 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 02:21:41.854100 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.854072 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bvs2z\"" Nov 04 02:21:41.855777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.855758 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf"] Nov 04 02:21:41.886826 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.886794 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-22fc67ff-nn5cf\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:41.886956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.886830 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbjnp\" (UniqueName: \"kubernetes.io/projected/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-kube-api-access-tbjnp\") pod \"maas-api-revoke-sub-22fc67ff-nn5cf\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:41.887088 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.887065 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-22fc67ff-nn5cf\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:41.988189 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.988157 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-22fc67ff-nn5cf\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:41.988361 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.988206 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-22fc67ff-nn5cf\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:41.988361 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.988241 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbjnp\" (UniqueName: \"kubernetes.io/projected/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-kube-api-access-tbjnp\") pod \"maas-api-revoke-sub-22fc67ff-nn5cf\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:41.988900 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.988882 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-22fc67ff-nn5cf\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:41.990622 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:41.990602 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-22fc67ff-nn5cf\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:42.049039 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:42.048989 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbjnp\" (UniqueName: \"kubernetes.io/projected/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-kube-api-access-tbjnp\") pod \"maas-api-revoke-sub-22fc67ff-nn5cf\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:42.064081 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:42.064062 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:42.435842 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:42.435815 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf"] Nov 04 02:21:42.438794 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:21:42.438768 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15eeeb4c_f0e6_443c_981d_15e0ef85dbc2.slice/crio-82175369b6999d24081b3082f8d13b843ce5e4ce2fa722d5c95b716e88963438 WatchSource:0}: Error finding container 82175369b6999d24081b3082f8d13b843ce5e4ce2fa722d5c95b716e88963438: Status 404 returned error can't find the container with id 82175369b6999d24081b3082f8d13b843ce5e4ce2fa722d5c95b716e88963438 Nov 04 02:21:43.326029 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:43.325999 5219 generic.go:356] "Generic (PLEG): container finished" podID="15eeeb4c-f0e6-443c-981d-15e0ef85dbc2" containerID="672289e30abcbd9a8f027b3e024a5506925a4bfb283597d6148239469437db7a" exitCode=0 Nov 04 02:21:43.326362 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:43.326085 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" event={"ID":"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2","Type":"ContainerDied","Data":"672289e30abcbd9a8f027b3e024a5506925a4bfb283597d6148239469437db7a"} Nov 04 02:21:43.326362 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:43.326140 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" event={"ID":"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2","Type":"ContainerStarted","Data":"82175369b6999d24081b3082f8d13b843ce5e4ce2fa722d5c95b716e88963438"} Nov 04 02:21:44.463632 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.463612 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:44.520134 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.520104 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-xks-ca\") pod \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " Nov 04 02:21:44.522188 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.522160 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-xks-ca" pod "15eeeb4c-f0e6-443c-981d-15e0ef85dbc2" (UID: "15eeeb4c-f0e6-443c-981d-15e0ef85dbc2"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:21:44.533000 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.532975 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" podUID="eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" containerName="main" containerID="cri-o://04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b" gracePeriod=45 Nov 04 02:21:44.620778 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.620713 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-openshift-ca\") pod \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " Nov 04 02:21:44.620910 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.620838 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-kube-api-access-tbjnp\" (UniqueName: \"kubernetes.io/projected/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-kube-api-access-tbjnp\") pod \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\" (UID: \"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2\") " Nov 04 02:21:44.621093 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.621077 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-xks-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:44.621093 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.621076 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-openshift-ca" pod "15eeeb4c-f0e6-443c-981d-15e0ef85dbc2" (UID: "15eeeb4c-f0e6-443c-981d-15e0ef85dbc2"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:21:44.622978 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.622956 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-kube-api-access-tbjnp" pod "15eeeb4c-f0e6-443c-981d-15e0ef85dbc2" (UID: "15eeeb4c-f0e6-443c-981d-15e0ef85dbc2"). InnerVolumeSpecName "kube-api-access-tbjnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:44.722762 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.722681 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbjnp\" (UniqueName: \"kubernetes.io/projected/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-kube-api-access-tbjnp\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:44.722762 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.722714 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2-maas-api-openshift-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:44.844267 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.844243 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:21:44.924736 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.924710 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-kube-api-access-npvm2\" (UniqueName: \"kubernetes.io/projected/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-kube-api-access-npvm2\") pod \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " Nov 04 02:21:44.924846 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.924754 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tmp-dir\") pod \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " Nov 04 02:21:44.924888 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.924866 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-home\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-home\") pod \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " Nov 04 02:21:44.924937 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.924916 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tls-certs\") pod \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " Nov 04 02:21:44.924986 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.924961 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-dshm\") pod \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " Nov 04 02:21:44.925032 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.924986 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tmp-dir" pod "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" (UID: "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:44.925071 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.925047 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-model-cache\") pod \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\" (UID: \"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0\") " Nov 04 02:21:44.925123 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.925101 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-home" pod "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" (UID: "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:44.925465 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.925368 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-model-cache" pod "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" (UID: "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:44.925465 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.925465 5219 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tmp-dir\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:44.925658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.925486 5219 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-home\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:44.925658 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.925496 5219 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-model-cache\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:44.927008 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.926982 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-kube-api-access-npvm2" pod "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" (UID: "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0"). InnerVolumeSpecName "kube-api-access-npvm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:44.927111 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.927037 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tls-certs" pod "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" (UID: "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:21:44.927111 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:44.927081 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-dshm" pod "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" (UID: "eb7c28ed-2173-4c5a-9d7a-d5b8279768e0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:45.026432 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.026403 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npvm2\" (UniqueName: \"kubernetes.io/projected/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-kube-api-access-npvm2\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:45.026432 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.026432 5219 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-tls-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:45.026630 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.026446 5219 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0-dshm\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:45.336425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.336353 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" Nov 04 02:21:45.336425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.336378 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf" event={"ID":"15eeeb4c-f0e6-443c-981d-15e0ef85dbc2","Type":"ContainerDied","Data":"82175369b6999d24081b3082f8d13b843ce5e4ce2fa722d5c95b716e88963438"} Nov 04 02:21:45.336425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.336424 5219 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82175369b6999d24081b3082f8d13b843ce5e4ce2fa722d5c95b716e88963438" Nov 04 02:21:45.337747 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.337725 5219 generic.go:356] "Generic (PLEG): container finished" podID="eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" containerID="04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b" exitCode=0 Nov 04 02:21:45.337882 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.337775 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" Nov 04 02:21:45.337882 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.337816 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" event={"ID":"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0","Type":"ContainerDied","Data":"04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b"} Nov 04 02:21:45.337882 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.337870 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m" event={"ID":"eb7c28ed-2173-4c5a-9d7a-d5b8279768e0","Type":"ContainerDied","Data":"d067a87a60a0d0a86bece402b9f215ad4b79e3b9d9ec59289926e7ac0f1c73fb"} Nov 04 02:21:45.338041 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.337891 5219 scope.go:122] "RemoveContainer" containerID="04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b" Nov 04 02:21:45.347204 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.347185 5219 scope.go:122] "RemoveContainer" containerID="04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b" Nov 04 02:21:45.347621 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:21:45.347595 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b\": container with ID starting with 04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b not found: ID does not exist" containerID="04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b" Nov 04 02:21:45.347706 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.347626 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b"} err="failed to get container status \"04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b\": rpc error: code = NotFound desc = could not find container \"04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b\": container with ID starting with 04cdf02581957dc108435cab175d7a471f8e2d347668f4eff1f58879b0cf7d4b not found: ID does not exist" Nov 04 02:21:45.579496 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.579467 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m"] Nov 04 02:21:45.588068 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.588018 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-9b0f0d/simulator-w2-9b0f0d-kserve-6d45c445f8-gkb4m"] Nov 04 02:21:45.912096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.909801 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g"] Nov 04 02:21:45.912096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.910382 5219 cpu_manager.go:414] "containerMap: removing container" podUID="eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" containerName="main" Nov 04 02:21:45.912096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.910402 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" containerName="main" Nov 04 02:21:45.912096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.910433 5219 cpu_manager.go:414] "containerMap: removing container" podUID="15eeeb4c-f0e6-443c-981d-15e0ef85dbc2" containerName="revoke-keys" Nov 04 02:21:45.912096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.910442 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15eeeb4c-f0e6-443c-981d-15e0ef85dbc2" containerName="revoke-keys" Nov 04 02:21:45.912096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.910547 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" containerName="main" Nov 04 02:21:45.912096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.910559 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="15eeeb4c-f0e6-443c-981d-15e0ef85dbc2" containerName="revoke-keys" Nov 04 02:21:45.915657 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.915636 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:45.971972 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.971950 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 02:21:45.972111 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.972056 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bvs2z\"" Nov 04 02:21:45.996311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:45.989656 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g"] Nov 04 02:21:46.037830 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.037803 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d7960fb7-ffl6g\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:46.038236 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.038211 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d7960fb7-ffl6g\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:46.038471 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.038454 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd28p\" (UniqueName: \"kubernetes.io/projected/a298da6f-54c2-4b99-941f-5aec312254d2-kube-api-access-nd28p\") pod \"maas-api-revoke-sub-d7960fb7-ffl6g\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:46.139102 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.139072 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d7960fb7-ffl6g\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:46.139254 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.139143 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd28p\" (UniqueName: \"kubernetes.io/projected/a298da6f-54c2-4b99-941f-5aec312254d2-kube-api-access-nd28p\") pod \"maas-api-revoke-sub-d7960fb7-ffl6g\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:46.139254 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.139183 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d7960fb7-ffl6g\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:46.139763 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.139740 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d7960fb7-ffl6g\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:46.141572 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.141555 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d7960fb7-ffl6g\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:46.202757 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.202736 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd28p\" (UniqueName: \"kubernetes.io/projected/a298da6f-54c2-4b99-941f-5aec312254d2-kube-api-access-nd28p\") pod \"maas-api-revoke-sub-d7960fb7-ffl6g\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:46.229119 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.229096 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:46.602521 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.602156 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g"] Nov 04 02:21:46.604770 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:21:46.604745 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda298da6f_54c2_4b99_941f_5aec312254d2.slice/crio-6445f00aba752ec541648db4e52f1c07ab2a5ed8a307ed5f74074d1cc9b5534e WatchSource:0}: Error finding container 6445f00aba752ec541648db4e52f1c07ab2a5ed8a307ed5f74074d1cc9b5534e: Status 404 returned error can't find the container with id 6445f00aba752ec541648db4e52f1c07ab2a5ed8a307ed5f74074d1cc9b5534e Nov 04 02:21:46.614370 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:46.614346 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eb7c28ed-2173-4c5a-9d7a-d5b8279768e0" path="/var/lib/kubelet/pods/eb7c28ed-2173-4c5a-9d7a-d5b8279768e0/volumes" Nov 04 02:21:47.350168 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:47.350135 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" event={"ID":"a298da6f-54c2-4b99-941f-5aec312254d2","Type":"ContainerStarted","Data":"78c191c8cfb3a0582f60b5bbbbb13732f837e04d123a44f4e663fcf97c597bc0"} Nov 04 02:21:47.350366 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:47.350187 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" event={"ID":"a298da6f-54c2-4b99-941f-5aec312254d2","Type":"ContainerStarted","Data":"6445f00aba752ec541648db4e52f1c07ab2a5ed8a307ed5f74074d1cc9b5534e"} Nov 04 02:21:47.474444 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:47.474400 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" podStartSLOduration=2.474385154 podStartE2EDuration="2.474385154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:47.472846623 +0000 UTC m=+852.961355323" watchObservedRunningTime="2026-11-04 02:21:47.474385154 +0000 UTC m=+852.962893848" Nov 04 02:21:48.356038 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.356005 5219 generic.go:356] "Generic (PLEG): container finished" podID="a298da6f-54c2-4b99-941f-5aec312254d2" containerID="78c191c8cfb3a0582f60b5bbbbb13732f837e04d123a44f4e663fcf97c597bc0" exitCode=0 Nov 04 02:21:48.356453 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.356041 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" event={"ID":"a298da6f-54c2-4b99-941f-5aec312254d2","Type":"ContainerDied","Data":"78c191c8cfb3a0582f60b5bbbbb13732f837e04d123a44f4e663fcf97c597bc0"} Nov 04 02:21:48.470381 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.470347 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg"] Nov 04 02:21:48.473779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.473760 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:48.531593 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.531527 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg"] Nov 04 02:21:48.560423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.560392 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d5qd\" (UniqueName: \"kubernetes.io/projected/6009d351-8a1e-4d00-89bb-0ef69e30a692-kube-api-access-7d5qd\") pod \"maas-api-revoke-sub-a2c552b1-b5tmg\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:48.560554 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.560454 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a2c552b1-b5tmg\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:48.560624 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.560597 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a2c552b1-b5tmg\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:48.661393 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.661322 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a2c552b1-b5tmg\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:48.661393 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.661373 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d5qd\" (UniqueName: \"kubernetes.io/projected/6009d351-8a1e-4d00-89bb-0ef69e30a692-kube-api-access-7d5qd\") pod \"maas-api-revoke-sub-a2c552b1-b5tmg\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:48.661560 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.661396 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a2c552b1-b5tmg\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:48.661926 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.661908 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a2c552b1-b5tmg\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:48.663729 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.663707 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a2c552b1-b5tmg\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:48.721571 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.721547 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d5qd\" (UniqueName: \"kubernetes.io/projected/6009d351-8a1e-4d00-89bb-0ef69e30a692-kube-api-access-7d5qd\") pod \"maas-api-revoke-sub-a2c552b1-b5tmg\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:48.785408 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:48.785371 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:49.162177 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.162148 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg"] Nov 04 02:21:49.165230 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:21:49.165194 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6009d351_8a1e_4d00_89bb_0ef69e30a692.slice/crio-b278720ccc9ad3f7e7946511fb0fe72cdb725941aa32f26175f3032e2ec621a2 WatchSource:0}: Error finding container b278720ccc9ad3f7e7946511fb0fe72cdb725941aa32f26175f3032e2ec621a2: Status 404 returned error can't find the container with id b278720ccc9ad3f7e7946511fb0fe72cdb725941aa32f26175f3032e2ec621a2 Nov 04 02:21:49.361866 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.361839 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" event={"ID":"6009d351-8a1e-4d00-89bb-0ef69e30a692","Type":"ContainerStarted","Data":"73dde1e2e5f21df2667ca91334cf55f9f3d260377b938ab9ea93460b3b5a7b32"} Nov 04 02:21:49.362223 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.361892 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" event={"ID":"6009d351-8a1e-4d00-89bb-0ef69e30a692","Type":"ContainerStarted","Data":"b278720ccc9ad3f7e7946511fb0fe72cdb725941aa32f26175f3032e2ec621a2"} Nov 04 02:21:49.479268 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.479221 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" podStartSLOduration=1.479208295 podStartE2EDuration="1.479208295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:49.477297868 +0000 UTC m=+854.965806560" watchObservedRunningTime="2026-11-04 02:21:49.479208295 +0000 UTC m=+854.967717043" Nov 04 02:21:49.484938 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.484917 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:49.568783 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.568754 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-xks-ca\") pod \"a298da6f-54c2-4b99-941f-5aec312254d2\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " Nov 04 02:21:49.568937 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.568804 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-openshift-ca\") pod \"a298da6f-54c2-4b99-941f-5aec312254d2\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " Nov 04 02:21:49.568937 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.568908 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a298da6f-54c2-4b99-941f-5aec312254d2-kube-api-access-nd28p\" (UniqueName: \"kubernetes.io/projected/a298da6f-54c2-4b99-941f-5aec312254d2-kube-api-access-nd28p\") pod \"a298da6f-54c2-4b99-941f-5aec312254d2\" (UID: \"a298da6f-54c2-4b99-941f-5aec312254d2\") " Nov 04 02:21:49.569204 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.569181 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-openshift-ca" pod "a298da6f-54c2-4b99-941f-5aec312254d2" (UID: "a298da6f-54c2-4b99-941f-5aec312254d2"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:21:49.570818 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.570789 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-xks-ca" pod "a298da6f-54c2-4b99-941f-5aec312254d2" (UID: "a298da6f-54c2-4b99-941f-5aec312254d2"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:21:49.570946 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.570884 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a298da6f-54c2-4b99-941f-5aec312254d2-kube-api-access-nd28p" pod "a298da6f-54c2-4b99-941f-5aec312254d2" (UID: "a298da6f-54c2-4b99-941f-5aec312254d2"). InnerVolumeSpecName "kube-api-access-nd28p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:49.670066 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.670028 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd28p\" (UniqueName: \"kubernetes.io/projected/a298da6f-54c2-4b99-941f-5aec312254d2-kube-api-access-nd28p\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:49.670066 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.670057 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-xks-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:49.670066 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:49.670071 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a298da6f-54c2-4b99-941f-5aec312254d2-maas-api-openshift-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:50.273323 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.269819 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" podUID="15289361-0f0d-41ec-bbdc-5e15a53f901f" containerName="main" containerID="cri-o://bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df" gracePeriod=45 Nov 04 02:21:50.344950 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.344852 5219 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" podUID="15289361-0f0d-41ec-bbdc-5e15a53f901f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.38:8000/ready\": dial tcp 10.134.0.38:8000: connect: connection refused" Nov 04 02:21:50.369843 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.369804 5219 generic.go:356] "Generic (PLEG): container finished" podID="6009d351-8a1e-4d00-89bb-0ef69e30a692" containerID="73dde1e2e5f21df2667ca91334cf55f9f3d260377b938ab9ea93460b3b5a7b32" exitCode=0 Nov 04 02:21:50.370271 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.369876 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" event={"ID":"6009d351-8a1e-4d00-89bb-0ef69e30a692","Type":"ContainerDied","Data":"73dde1e2e5f21df2667ca91334cf55f9f3d260377b938ab9ea93460b3b5a7b32"} Nov 04 02:21:50.371812 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.371790 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" event={"ID":"a298da6f-54c2-4b99-941f-5aec312254d2","Type":"ContainerDied","Data":"6445f00aba752ec541648db4e52f1c07ab2a5ed8a307ed5f74074d1cc9b5534e"} Nov 04 02:21:50.371891 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.371830 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g" Nov 04 02:21:50.371938 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.371835 5219 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6445f00aba752ec541648db4e52f1c07ab2a5ed8a307ed5f74074d1cc9b5534e" Nov 04 02:21:50.648506 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.648481 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:21:50.800314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.793935 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-model-cache\") pod \"15289361-0f0d-41ec-bbdc-5e15a53f901f\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " Nov 04 02:21:50.800314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.793994 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-dshm\") pod \"15289361-0f0d-41ec-bbdc-5e15a53f901f\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " Nov 04 02:21:50.800314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.794078 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15289361-0f0d-41ec-bbdc-5e15a53f901f-kube-api-access-267tt\" (UniqueName: \"kubernetes.io/projected/15289361-0f0d-41ec-bbdc-5e15a53f901f-kube-api-access-267tt\") pod \"15289361-0f0d-41ec-bbdc-5e15a53f901f\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " Nov 04 02:21:50.800314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.794160 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/15289361-0f0d-41ec-bbdc-5e15a53f901f-tls-certs\" (UniqueName: \"kubernetes.io/secret/15289361-0f0d-41ec-bbdc-5e15a53f901f-tls-certs\") pod \"15289361-0f0d-41ec-bbdc-5e15a53f901f\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " Nov 04 02:21:50.800314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.794245 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-home\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-home\") pod \"15289361-0f0d-41ec-bbdc-5e15a53f901f\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " Nov 04 02:21:50.800314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.794275 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-tmp-dir\") pod \"15289361-0f0d-41ec-bbdc-5e15a53f901f\" (UID: \"15289361-0f0d-41ec-bbdc-5e15a53f901f\") " Nov 04 02:21:50.800314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.795485 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-tmp-dir" pod "15289361-0f0d-41ec-bbdc-5e15a53f901f" (UID: "15289361-0f0d-41ec-bbdc-5e15a53f901f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:50.800314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.795848 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-model-cache" pod "15289361-0f0d-41ec-bbdc-5e15a53f901f" (UID: "15289361-0f0d-41ec-bbdc-5e15a53f901f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:50.800314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.799153 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-home" pod "15289361-0f0d-41ec-bbdc-5e15a53f901f" (UID: "15289361-0f0d-41ec-bbdc-5e15a53f901f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:50.809307 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.805415 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15289361-0f0d-41ec-bbdc-5e15a53f901f-tls-certs" pod "15289361-0f0d-41ec-bbdc-5e15a53f901f" (UID: "15289361-0f0d-41ec-bbdc-5e15a53f901f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:21:50.816492 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.813997 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-dshm" pod "15289361-0f0d-41ec-bbdc-5e15a53f901f" (UID: "15289361-0f0d-41ec-bbdc-5e15a53f901f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:50.816492 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.814683 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15289361-0f0d-41ec-bbdc-5e15a53f901f-kube-api-access-267tt" pod "15289361-0f0d-41ec-bbdc-5e15a53f901f" (UID: "15289361-0f0d-41ec-bbdc-5e15a53f901f"). InnerVolumeSpecName "kube-api-access-267tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:50.896280 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.896183 5219 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-model-cache\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:50.896280 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.896226 5219 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-dshm\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:50.896280 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.896242 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-267tt\" (UniqueName: \"kubernetes.io/projected/15289361-0f0d-41ec-bbdc-5e15a53f901f-kube-api-access-267tt\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:50.896280 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.896257 5219 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15289361-0f0d-41ec-bbdc-5e15a53f901f-tls-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:50.896280 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.896270 5219 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-home\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:50.896280 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:50.896302 5219 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15289361-0f0d-41ec-bbdc-5e15a53f901f-tmp-dir\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:51.348890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.348847 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7"] Nov 04 02:21:51.378066 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.378034 5219 generic.go:356] "Generic (PLEG): container finished" podID="15289361-0f0d-41ec-bbdc-5e15a53f901f" containerID="bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df" exitCode=0 Nov 04 02:21:51.378488 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.378081 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" Nov 04 02:21:51.378488 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.378124 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" event={"ID":"15289361-0f0d-41ec-bbdc-5e15a53f901f","Type":"ContainerDied","Data":"bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df"} Nov 04 02:21:51.378488 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.378170 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87" event={"ID":"15289361-0f0d-41ec-bbdc-5e15a53f901f","Type":"ContainerDied","Data":"9f3e7f54f9d8efbc349dd2f261ffb016ac7e68d0729494f50f8f97fc64edda01"} Nov 04 02:21:51.378488 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.378194 5219 scope.go:122] "RemoveContainer" containerID="bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df" Nov 04 02:21:51.392125 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.392102 5219 scope.go:122] "RemoveContainer" containerID="bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df" Nov 04 02:21:51.392648 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:21:51.392624 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df\": container with ID starting with bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df not found: ID does not exist" containerID="bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df" Nov 04 02:21:51.392732 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.392658 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df"} err="failed to get container status \"bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df\": rpc error: code = NotFound desc = could not find container \"bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df\": container with ID starting with bbdd05e979e08b305e8fb48b1bdaaab421c1423b4836370dc8061f00879082df not found: ID does not exist" Nov 04 02:21:51.519586 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.519563 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:51.580053 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.580024 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87"] Nov 04 02:21:51.583926 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.583901 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-5a27ba/simulator-w3-5a27ba-kserve-7796c6fd78-2hm87"] Nov 04 02:21:51.602570 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.602523 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-xks-ca\") pod \"6009d351-8a1e-4d00-89bb-0ef69e30a692\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " Nov 04 02:21:51.602651 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.602632 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-openshift-ca\") pod \"6009d351-8a1e-4d00-89bb-0ef69e30a692\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " Nov 04 02:21:51.602693 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.602662 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6009d351-8a1e-4d00-89bb-0ef69e30a692-kube-api-access-7d5qd\" (UniqueName: \"kubernetes.io/projected/6009d351-8a1e-4d00-89bb-0ef69e30a692-kube-api-access-7d5qd\") pod \"6009d351-8a1e-4d00-89bb-0ef69e30a692\" (UID: \"6009d351-8a1e-4d00-89bb-0ef69e30a692\") " Nov 04 02:21:51.602952 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.602933 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-openshift-ca" pod "6009d351-8a1e-4d00-89bb-0ef69e30a692" (UID: "6009d351-8a1e-4d00-89bb-0ef69e30a692"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:21:51.604779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.604753 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-xks-ca" pod "6009d351-8a1e-4d00-89bb-0ef69e30a692" (UID: "6009d351-8a1e-4d00-89bb-0ef69e30a692"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:21:51.604779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.604771 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6009d351-8a1e-4d00-89bb-0ef69e30a692-kube-api-access-7d5qd" pod "6009d351-8a1e-4d00-89bb-0ef69e30a692" (UID: "6009d351-8a1e-4d00-89bb-0ef69e30a692"). InnerVolumeSpecName "kube-api-access-7d5qd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:51.704187 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.704149 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d5qd\" (UniqueName: \"kubernetes.io/projected/6009d351-8a1e-4d00-89bb-0ef69e30a692-kube-api-access-7d5qd\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:51.704187 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.704187 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-xks-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:51.704453 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.704202 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6009d351-8a1e-4d00-89bb-0ef69e30a692-maas-api-openshift-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:51.986967 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.986934 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c"] Nov 04 02:21:51.987373 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.987353 5219 cpu_manager.go:414] "containerMap: removing container" podUID="6009d351-8a1e-4d00-89bb-0ef69e30a692" containerName="revoke-keys" Nov 04 02:21:51.987373 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.987373 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6009d351-8a1e-4d00-89bb-0ef69e30a692" containerName="revoke-keys" Nov 04 02:21:51.987543 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.987401 5219 cpu_manager.go:414] "containerMap: removing container" podUID="15289361-0f0d-41ec-bbdc-5e15a53f901f" containerName="main" Nov 04 02:21:51.987543 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.987406 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15289361-0f0d-41ec-bbdc-5e15a53f901f" containerName="main" Nov 04 02:21:51.987543 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.987418 5219 cpu_manager.go:414] "containerMap: removing container" podUID="a298da6f-54c2-4b99-941f-5aec312254d2" containerName="revoke-keys" Nov 04 02:21:51.987543 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.987423 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a298da6f-54c2-4b99-941f-5aec312254d2" containerName="revoke-keys" Nov 04 02:21:51.987543 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.987481 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="6009d351-8a1e-4d00-89bb-0ef69e30a692" containerName="revoke-keys" Nov 04 02:21:51.987543 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.987494 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="15289361-0f0d-41ec-bbdc-5e15a53f901f" containerName="main" Nov 04 02:21:51.987543 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.987500 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="a298da6f-54c2-4b99-941f-5aec312254d2" containerName="revoke-keys" Nov 04 02:21:51.990517 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:51.990498 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.047946 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.047923 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c"] Nov 04 02:21:52.109082 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.109051 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-93bc7083-n998c\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.109196 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.109094 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrp2k\" (UniqueName: \"kubernetes.io/projected/10c85d5c-deac-46bc-88bf-856ed8f3aabc-kube-api-access-mrp2k\") pod \"maas-api-revoke-sub-93bc7083-n998c\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.109315 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.109271 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-93bc7083-n998c\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.210017 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.209989 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-93bc7083-n998c\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.210181 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.210057 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-93bc7083-n998c\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.210181 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.210090 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrp2k\" (UniqueName: \"kubernetes.io/projected/10c85d5c-deac-46bc-88bf-856ed8f3aabc-kube-api-access-mrp2k\") pod \"maas-api-revoke-sub-93bc7083-n998c\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.210837 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.210740 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-93bc7083-n998c\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.212406 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.212385 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-93bc7083-n998c\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.270586 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.270532 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrp2k\" (UniqueName: \"kubernetes.io/projected/10c85d5c-deac-46bc-88bf-856ed8f3aabc-kube-api-access-mrp2k\") pod \"maas-api-revoke-sub-93bc7083-n998c\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.303603 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.303581 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:52.386828 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.386804 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" Nov 04 02:21:52.386828 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.386812 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg" event={"ID":"6009d351-8a1e-4d00-89bb-0ef69e30a692","Type":"ContainerDied","Data":"b278720ccc9ad3f7e7946511fb0fe72cdb725941aa32f26175f3032e2ec621a2"} Nov 04 02:21:52.387262 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.386860 5219 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b278720ccc9ad3f7e7946511fb0fe72cdb725941aa32f26175f3032e2ec621a2" Nov 04 02:21:52.616614 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.616540 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15289361-0f0d-41ec-bbdc-5e15a53f901f" path="/var/lib/kubelet/pods/15289361-0f0d-41ec-bbdc-5e15a53f901f/volumes" Nov 04 02:21:52.679631 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.679370 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c"] Nov 04 02:21:52.682002 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:21:52.681975 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c85d5c_deac_46bc_88bf_856ed8f3aabc.slice/crio-dd5d1514484ac5d1e3db155f0f77e5ab75780c88cd7e7848fcbafd04e20b2aad WatchSource:0}: Error finding container dd5d1514484ac5d1e3db155f0f77e5ab75780c88cd7e7848fcbafd04e20b2aad: Status 404 returned error can't find the container with id dd5d1514484ac5d1e3db155f0f77e5ab75780c88cd7e7848fcbafd04e20b2aad Nov 04 02:21:52.749229 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.749196 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g"] Nov 04 02:21:52.749477 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.749452 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerName="istio-proxy" containerID="cri-o://cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5" gracePeriod=30 Nov 04 02:21:52.757821 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.757777 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg"] Nov 04 02:21:52.764345 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.763403 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:52.816022 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.815994 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-dd5d18-openshift-default-dockercfg-5qdvr\"" Nov 04 02:21:52.824107 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.824080 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg"] Nov 04 02:21:52.917640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.916954 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:52.917640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.917035 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rr62\" (UniqueName: \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-kube-api-access-4rr62\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:52.917640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.917078 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-podinfo\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:52.917640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.917113 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-credential-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:52.917640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.917135 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-certs\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:52.917640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.917183 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-token\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:52.917640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.917213 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408600b3-be86-4e51-9c54-cd40eb3ef49e-istiod-ca-cert\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:52.917640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.917266 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-envoy\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:52.917640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:52.917328 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-data\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.020571 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408600b3-be86-4e51-9c54-cd40eb3ef49e-istiod-ca-cert\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.020632 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-envoy\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.020674 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-data\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.020763 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.020812 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rr62\" (UniqueName: \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-kube-api-access-4rr62\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.020853 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-podinfo\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.020887 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-credential-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.020911 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-certs\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.020957 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-token\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.021956 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408600b3-be86-4e51-9c54-cd40eb3ef49e-istiod-ca-cert\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.022734 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-data\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.022943 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.023154 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-credential-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.024332 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.023728 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-certs\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.026132 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.025942 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-envoy\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.028869 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.028848 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-podinfo\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.081161 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.081141 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-token\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.082395 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.082378 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rr62\" (UniqueName: \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-kube-api-access-4rr62\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.111970 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.111950 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:53.395121 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.395089 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" event={"ID":"10c85d5c-deac-46bc-88bf-856ed8f3aabc","Type":"ContainerStarted","Data":"fb73c8c4ece9ad5d0e82037710938289bc83ae897229c7037bc0d28e5b474643"} Nov 04 02:21:53.395630 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.395139 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" event={"ID":"10c85d5c-deac-46bc-88bf-856ed8f3aabc","Type":"ContainerStarted","Data":"dd5d1514484ac5d1e3db155f0f77e5ab75780c88cd7e7848fcbafd04e20b2aad"} Nov 04 02:21:53.509995 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.509896 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" podStartSLOduration=2.509879138 podStartE2EDuration="2.509879138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:53.508808514 +0000 UTC m=+858.997317215" watchObservedRunningTime="2026-11-04 02:21:53.509879138 +0000 UTC m=+858.998387842" Nov 04 02:21:53.546845 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.546827 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg"] Nov 04 02:21:53.549313 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:21:53.549270 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408600b3_be86_4e51_9c54_cd40eb3ef49e.slice/crio-7e017a360e21b06aedb592164468072b7c2b89217124bcca1795a9b541c46530 WatchSource:0}: Error finding container 7e017a360e21b06aedb592164468072b7c2b89217124bcca1795a9b541c46530: Status 404 returned error can't find the container with id 7e017a360e21b06aedb592164468072b7c2b89217124bcca1795a9b541c46530 Nov 04 02:21:53.551448 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.551417 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:21:53.551515 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.551479 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:21:53.551515 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:53.551505 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:21:54.402002 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:54.401969 5219 generic.go:356] "Generic (PLEG): container finished" podID="10c85d5c-deac-46bc-88bf-856ed8f3aabc" containerID="fb73c8c4ece9ad5d0e82037710938289bc83ae897229c7037bc0d28e5b474643" exitCode=0 Nov 04 02:21:54.402460 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:54.402054 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" event={"ID":"10c85d5c-deac-46bc-88bf-856ed8f3aabc","Type":"ContainerDied","Data":"fb73c8c4ece9ad5d0e82037710938289bc83ae897229c7037bc0d28e5b474643"} Nov 04 02:21:54.403743 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:54.403718 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" event={"ID":"408600b3-be86-4e51-9c54-cd40eb3ef49e","Type":"ContainerStarted","Data":"28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20"} Nov 04 02:21:54.403879 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:54.403759 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" event={"ID":"408600b3-be86-4e51-9c54-cd40eb3ef49e","Type":"ContainerStarted","Data":"7e017a360e21b06aedb592164468072b7c2b89217124bcca1795a9b541c46530"} Nov 04 02:21:54.645333 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:54.645263 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" podStartSLOduration=2.645248597 podStartE2EDuration="2.645248597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:54.643562116 +0000 UTC m=+860.132070816" watchObservedRunningTime="2026-11-04 02:21:54.645248597 +0000 UTC m=+860.133757366" Nov 04 02:21:55.145313 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.144387 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:21:55.145585 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.145557 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Nov 04 02:21:55.145794 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.145768 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Nov 04 02:21:55.648548 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.648526 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:55.777608 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.777580 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10c85d5c-deac-46bc-88bf-856ed8f3aabc-kube-api-access-mrp2k\" (UniqueName: \"kubernetes.io/projected/10c85d5c-deac-46bc-88bf-856ed8f3aabc-kube-api-access-mrp2k\") pod \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " Nov 04 02:21:55.777755 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.777673 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-xks-ca\") pod \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " Nov 04 02:21:55.777755 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.777705 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-openshift-ca\") pod \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\" (UID: \"10c85d5c-deac-46bc-88bf-856ed8f3aabc\") " Nov 04 02:21:55.778112 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.778084 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-openshift-ca" pod "10c85d5c-deac-46bc-88bf-856ed8f3aabc" (UID: "10c85d5c-deac-46bc-88bf-856ed8f3aabc"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:21:55.779728 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.779708 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10c85d5c-deac-46bc-88bf-856ed8f3aabc-kube-api-access-mrp2k" pod "10c85d5c-deac-46bc-88bf-856ed8f3aabc" (UID: "10c85d5c-deac-46bc-88bf-856ed8f3aabc"). InnerVolumeSpecName "kube-api-access-mrp2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:55.779866 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.779849 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-xks-ca" pod "10c85d5c-deac-46bc-88bf-856ed8f3aabc" (UID: "10c85d5c-deac-46bc-88bf-856ed8f3aabc"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:21:55.878917 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.878892 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrp2k\" (UniqueName: \"kubernetes.io/projected/10c85d5c-deac-46bc-88bf-856ed8f3aabc-kube-api-access-mrp2k\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:55.878917 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.878915 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-xks-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:55.879061 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:55.878925 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/10c85d5c-deac-46bc-88bf-856ed8f3aabc-maas-api-openshift-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:56.112786 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:56.112712 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Nov 04 02:21:56.112786 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:56.112761 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Nov 04 02:21:56.152860 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:56.152832 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494"] Nov 04 02:21:56.262333 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:56.262304 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq"] Nov 04 02:21:56.349829 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:56.349781 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" podUID="e429a663-e33a-4104-baf1-9b208d58ab22" containerName="payload-pre-processing" containerID="cri-o://3f491efe629855ba0fd41b24c8a83ac116cf1c3c99df31bf42f23423e897c985" gracePeriod=25 Nov 04 02:21:56.441308 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:56.438759 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" Nov 04 02:21:56.441308 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:56.439030 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c" event={"ID":"10c85d5c-deac-46bc-88bf-856ed8f3aabc","Type":"ContainerDied","Data":"dd5d1514484ac5d1e3db155f0f77e5ab75780c88cd7e7848fcbafd04e20b2aad"} Nov 04 02:21:56.441308 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:56.439173 5219 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd5d1514484ac5d1e3db155f0f77e5ab75780c88cd7e7848fcbafd04e20b2aad" Nov 04 02:21:57.113181 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:57.113151 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Nov 04 02:21:57.113578 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:57.113200 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Nov 04 02:21:58.066945 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.066921 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:21:58.113197 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.113146 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Nov 04 02:21:58.113197 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.113190 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Nov 04 02:21:58.140750 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.140723 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-certs\") pod \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " Nov 04 02:21:58.140903 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.140773 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-socket\") pod \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " Nov 04 02:21:58.140903 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.140819 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-credential-socket\") pod \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " Nov 04 02:21:58.140903 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.140846 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-kube-api-access-j4rjr\" (UniqueName: \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-kube-api-access-j4rjr\") pod \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " Nov 04 02:21:58.140903 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.140868 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istiod-ca-cert\") pod \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " Nov 04 02:21:58.140903 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.140884 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-token\" (UniqueName: \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-token\") pod \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " Nov 04 02:21:58.141111 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.140913 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-data\") pod \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " Nov 04 02:21:58.141111 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.140959 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-envoy\") pod \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " Nov 04 02:21:58.141111 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.141019 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-podinfo\") pod \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\" (UID: \"0ef9f4e1-ad1c-4578-b9aa-dd226508698a\") " Nov 04 02:21:58.141111 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.141079 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-socket" pod "0ef9f4e1-ad1c-4578-b9aa-dd226508698a" (UID: "0ef9f4e1-ad1c-4578-b9aa-dd226508698a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:58.141359 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.141113 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-certs" pod "0ef9f4e1-ad1c-4578-b9aa-dd226508698a" (UID: "0ef9f4e1-ad1c-4578-b9aa-dd226508698a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:58.141359 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.141265 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-data" pod "0ef9f4e1-ad1c-4578-b9aa-dd226508698a" (UID: "0ef9f4e1-ad1c-4578-b9aa-dd226508698a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:58.141359 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.141336 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istiod-ca-cert" pod "0ef9f4e1-ad1c-4578-b9aa-dd226508698a" (UID: "0ef9f4e1-ad1c-4578-b9aa-dd226508698a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:21:58.141512 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.141442 5219 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istiod-ca-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:58.141512 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.141461 5219 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-data\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:58.141512 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.141473 5219 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:58.141649 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.141589 5219 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-workload-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:58.141649 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.141587 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-credential-socket" pod "0ef9f4e1-ad1c-4578-b9aa-dd226508698a" (UID: "0ef9f4e1-ad1c-4578-b9aa-dd226508698a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:58.143937 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.143914 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-envoy" pod "0ef9f4e1-ad1c-4578-b9aa-dd226508698a" (UID: "0ef9f4e1-ad1c-4578-b9aa-dd226508698a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:21:58.144019 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.143999 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-token" pod "0ef9f4e1-ad1c-4578-b9aa-dd226508698a" (UID: "0ef9f4e1-ad1c-4578-b9aa-dd226508698a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:58.144142 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.144117 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-podinfo" pod "0ef9f4e1-ad1c-4578-b9aa-dd226508698a" (UID: "0ef9f4e1-ad1c-4578-b9aa-dd226508698a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:21:58.144270 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.144255 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-kube-api-access-j4rjr" pod "0ef9f4e1-ad1c-4578-b9aa-dd226508698a" (UID: "0ef9f4e1-ad1c-4578-b9aa-dd226508698a"). InnerVolumeSpecName "kube-api-access-j4rjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:21:58.242580 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.242553 5219 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-credential-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:58.242707 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.242596 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4rjr\" (UniqueName: \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-kube-api-access-j4rjr\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:58.242707 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.242607 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:58.242707 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.242615 5219 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-envoy\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:58.242707 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.242623 5219 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ef9f4e1-ad1c-4578-b9aa-dd226508698a-istio-podinfo\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:21:58.450217 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.450184 5219 generic.go:356] "Generic (PLEG): container finished" podID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerID="cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5" exitCode=0 Nov 04 02:21:58.450456 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.450247 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" Nov 04 02:21:58.450456 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.450275 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" event={"ID":"0ef9f4e1-ad1c-4578-b9aa-dd226508698a","Type":"ContainerDied","Data":"cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5"} Nov 04 02:21:58.450456 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.450384 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g" event={"ID":"0ef9f4e1-ad1c-4578-b9aa-dd226508698a","Type":"ContainerDied","Data":"70f579a3766729150b620d8548aff4b5a314c3828044bd5f0388044db035988c"} Nov 04 02:21:58.450456 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.450407 5219 scope.go:122] "RemoveContainer" containerID="cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5" Nov 04 02:21:58.464793 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.464765 5219 scope.go:122] "RemoveContainer" containerID="cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5" Nov 04 02:21:58.465144 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:21:58.465110 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5\": container with ID starting with cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5 not found: ID does not exist" containerID="cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5" Nov 04 02:21:58.465239 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.465146 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5"} err="failed to get container status \"cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5\": rpc error: code = NotFound desc = could not find container \"cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5\": container with ID starting with cc74b0ea570a5555928f6aac6e8e13c3a0f8d936ffb5c4debe932457dc333cc5 not found: ID does not exist" Nov 04 02:21:58.614770 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.614745 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g"] Nov 04 02:21:58.635312 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:58.617760 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hqs5g"] Nov 04 02:21:59.113250 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:59.113213 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Nov 04 02:21:59.113621 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:59.113275 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Nov 04 02:21:59.813422 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:21:59.813383 5219 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" podUID="e429a663-e33a-4104-baf1-9b208d58ab22" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 02:22:00.112774 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:00.112702 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Nov 04 02:22:00.112774 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:00.112749 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Nov 04 02:22:00.616094 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:00.616059 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" path="/var/lib/kubelet/pods/0ef9f4e1-ad1c-4578-b9aa-dd226508698a/volumes" Nov 04 02:22:01.117104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.117075 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:22:01.117605 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.117578 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:22:01.118345 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.118329 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:22:01.153104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.153050 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" podUID="77ca6e9c-edc4-4d12-a75e-96c056086871" containerName="payload-processing" containerID="cri-o://269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d" gracePeriod=25 Nov 04 02:22:01.262615 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.262585 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" podUID="57cdc8cd-3b59-4081-a93d-1a42043ff046" containerName="payload-pre-processing" containerID="cri-o://83db85ee95f3a631a3522fb4b143465f7c218aec4df46027a3e83aa749e5a00b" gracePeriod=25 Nov 04 02:22:01.420705 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.420440 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:22:01.474883 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.474851 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/77ca6e9c-edc4-4d12-a75e-96c056086871-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77ca6e9c-edc4-4d12-a75e-96c056086871-plugins-config-volume\") pod \"77ca6e9c-edc4-4d12-a75e-96c056086871\" (UID: \"77ca6e9c-edc4-4d12-a75e-96c056086871\") " Nov 04 02:22:01.475060 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.474934 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77ca6e9c-edc4-4d12-a75e-96c056086871-kube-api-access-ccvxk\" (UniqueName: \"kubernetes.io/projected/77ca6e9c-edc4-4d12-a75e-96c056086871-kube-api-access-ccvxk\") pod \"77ca6e9c-edc4-4d12-a75e-96c056086871\" (UID: \"77ca6e9c-edc4-4d12-a75e-96c056086871\") " Nov 04 02:22:01.475862 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.475825 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77ca6e9c-edc4-4d12-a75e-96c056086871-plugins-config-volume" pod "77ca6e9c-edc4-4d12-a75e-96c056086871" (UID: "77ca6e9c-edc4-4d12-a75e-96c056086871"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:22:01.478836 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.478810 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ca6e9c-edc4-4d12-a75e-96c056086871-kube-api-access-ccvxk" pod "77ca6e9c-edc4-4d12-a75e-96c056086871" (UID: "77ca6e9c-edc4-4d12-a75e-96c056086871"). InnerVolumeSpecName "kube-api-access-ccvxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:22:01.478983 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.478958 5219 generic.go:356] "Generic (PLEG): container finished" podID="57cdc8cd-3b59-4081-a93d-1a42043ff046" containerID="83db85ee95f3a631a3522fb4b143465f7c218aec4df46027a3e83aa749e5a00b" exitCode=0 Nov 04 02:22:01.479058 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.479033 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" event={"ID":"57cdc8cd-3b59-4081-a93d-1a42043ff046","Type":"ContainerDied","Data":"83db85ee95f3a631a3522fb4b143465f7c218aec4df46027a3e83aa749e5a00b"} Nov 04 02:22:01.480454 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.480432 5219 generic.go:356] "Generic (PLEG): container finished" podID="77ca6e9c-edc4-4d12-a75e-96c056086871" containerID="269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d" exitCode=0 Nov 04 02:22:01.480555 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.480461 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" event={"ID":"77ca6e9c-edc4-4d12-a75e-96c056086871","Type":"ContainerDied","Data":"269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d"} Nov 04 02:22:01.480555 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.480502 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" event={"ID":"77ca6e9c-edc4-4d12-a75e-96c056086871","Type":"ContainerDied","Data":"752e251acbcb7b091ff506224df9b9a753664a6cee064e7ba9dad0e28f8b099d"} Nov 04 02:22:01.480555 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.480503 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494" Nov 04 02:22:01.480555 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.480529 5219 scope.go:122] "RemoveContainer" containerID="269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d" Nov 04 02:22:01.493219 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.493197 5219 scope.go:122] "RemoveContainer" containerID="269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d" Nov 04 02:22:01.493573 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:22:01.493552 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d\": container with ID starting with 269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d not found: ID does not exist" containerID="269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d" Nov 04 02:22:01.493655 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.493585 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d"} err="failed to get container status \"269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d\": rpc error: code = NotFound desc = could not find container \"269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d\": container with ID starting with 269aa291547b88e5e26b50dca219bd271e1229e860c730297903a3e6f46bf67d not found: ID does not exist" Nov 04 02:22:01.523542 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.523505 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:22:01.575886 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.575855 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57cdc8cd-3b59-4081-a93d-1a42043ff046-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57cdc8cd-3b59-4081-a93d-1a42043ff046-plugins-config-volume\") pod \"57cdc8cd-3b59-4081-a93d-1a42043ff046\" (UID: \"57cdc8cd-3b59-4081-a93d-1a42043ff046\") " Nov 04 02:22:01.576026 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.575991 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57cdc8cd-3b59-4081-a93d-1a42043ff046-kube-api-access-6nnc8\" (UniqueName: \"kubernetes.io/projected/57cdc8cd-3b59-4081-a93d-1a42043ff046-kube-api-access-6nnc8\") pod \"57cdc8cd-3b59-4081-a93d-1a42043ff046\" (UID: \"57cdc8cd-3b59-4081-a93d-1a42043ff046\") " Nov 04 02:22:01.576238 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.576215 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57cdc8cd-3b59-4081-a93d-1a42043ff046-plugins-config-volume" pod "57cdc8cd-3b59-4081-a93d-1a42043ff046" (UID: "57cdc8cd-3b59-4081-a93d-1a42043ff046"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:22:01.576542 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.576516 5219 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77ca6e9c-edc4-4d12-a75e-96c056086871-plugins-config-volume\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:01.576639 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.576547 5219 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57cdc8cd-3b59-4081-a93d-1a42043ff046-plugins-config-volume\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:01.576639 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.576565 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccvxk\" (UniqueName: \"kubernetes.io/projected/77ca6e9c-edc4-4d12-a75e-96c056086871-kube-api-access-ccvxk\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:01.578138 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.578116 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57cdc8cd-3b59-4081-a93d-1a42043ff046-kube-api-access-6nnc8" pod "57cdc8cd-3b59-4081-a93d-1a42043ff046" (UID: "57cdc8cd-3b59-4081-a93d-1a42043ff046"). InnerVolumeSpecName "kube-api-access-6nnc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:22:01.646574 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.646523 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494"] Nov 04 02:22:01.652387 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.652366 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e970c7-8554c795b8-c7494"] Nov 04 02:22:01.677340 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:01.677314 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nnc8\" (UniqueName: \"kubernetes.io/projected/57cdc8cd-3b59-4081-a93d-1a42043ff046-kube-api-access-6nnc8\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:02.486672 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:02.486646 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" Nov 04 02:22:02.486672 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:02.486659 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq" event={"ID":"57cdc8cd-3b59-4081-a93d-1a42043ff046","Type":"ContainerDied","Data":"aaf43033d1482e00c9d2e1b31182838fa8e2afb1c8eff3a2c5bf4ad5ae84970e"} Nov 04 02:22:02.486916 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:02.486717 5219 scope.go:122] "RemoveContainer" containerID="83db85ee95f3a631a3522fb4b143465f7c218aec4df46027a3e83aa749e5a00b" Nov 04 02:22:02.614112 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:02.614079 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77ca6e9c-edc4-4d12-a75e-96c056086871" path="/var/lib/kubelet/pods/77ca6e9c-edc4-4d12-a75e-96c056086871/volumes" Nov 04 02:22:02.651157 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:02.651132 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq"] Nov 04 02:22:02.700531 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:02.700494 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-e970c7-cc5b48ff5-gsjsq"] Nov 04 02:22:04.614082 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:04.614053 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="57cdc8cd-3b59-4081-a93d-1a42043ff046" path="/var/lib/kubelet/pods/57cdc8cd-3b59-4081-a93d-1a42043ff046/volumes" Nov 04 02:22:08.928705 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:22:08.928659 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:22:09.813851 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:09.813816 5219 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" podUID="e429a663-e33a-4104-baf1-9b208d58ab22" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 02:22:13.565351 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:13.565305 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:22:16.602808 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:16.602773 5219 generic.go:356] "Generic (PLEG): container finished" podID="e429a663-e33a-4104-baf1-9b208d58ab22" containerID="3f491efe629855ba0fd41b24c8a83ac116cf1c3c99df31bf42f23423e897c985" exitCode=0 Nov 04 02:22:16.603188 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:16.602833 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" event={"ID":"e429a663-e33a-4104-baf1-9b208d58ab22","Type":"ContainerDied","Data":"3f491efe629855ba0fd41b24c8a83ac116cf1c3c99df31bf42f23423e897c985"} Nov 04 02:22:16.633955 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:16.633929 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:22:16.762563 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:16.762536 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e429a663-e33a-4104-baf1-9b208d58ab22-kube-api-access-6qc9b\" (UniqueName: \"kubernetes.io/projected/e429a663-e33a-4104-baf1-9b208d58ab22-kube-api-access-6qc9b\") pod \"e429a663-e33a-4104-baf1-9b208d58ab22\" (UID: \"e429a663-e33a-4104-baf1-9b208d58ab22\") " Nov 04 02:22:16.762795 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:16.762625 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e429a663-e33a-4104-baf1-9b208d58ab22-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e429a663-e33a-4104-baf1-9b208d58ab22-plugins-config-volume\") pod \"e429a663-e33a-4104-baf1-9b208d58ab22\" (UID: \"e429a663-e33a-4104-baf1-9b208d58ab22\") " Nov 04 02:22:16.762963 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:16.762943 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e429a663-e33a-4104-baf1-9b208d58ab22-plugins-config-volume" pod "e429a663-e33a-4104-baf1-9b208d58ab22" (UID: "e429a663-e33a-4104-baf1-9b208d58ab22"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:22:16.764787 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:16.764759 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e429a663-e33a-4104-baf1-9b208d58ab22-kube-api-access-6qc9b" pod "e429a663-e33a-4104-baf1-9b208d58ab22" (UID: "e429a663-e33a-4104-baf1-9b208d58ab22"). InnerVolumeSpecName "kube-api-access-6qc9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:22:16.864132 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:16.864066 5219 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e429a663-e33a-4104-baf1-9b208d58ab22-plugins-config-volume\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:16.864132 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:16.864093 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qc9b\" (UniqueName: \"kubernetes.io/projected/e429a663-e33a-4104-baf1-9b208d58ab22-kube-api-access-6qc9b\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:17.610247 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:17.610214 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" Nov 04 02:22:17.610711 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:17.610215 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7" event={"ID":"e429a663-e33a-4104-baf1-9b208d58ab22","Type":"ContainerDied","Data":"0231266edd2a14149fb10a22f50298ca857f359903a2fd20d107d3c8a50ae5a4"} Nov 04 02:22:17.610711 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:17.610349 5219 scope.go:122] "RemoveContainer" containerID="3f491efe629855ba0fd41b24c8a83ac116cf1c3c99df31bf42f23423e897c985" Nov 04 02:22:17.774913 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:17.774882 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7"] Nov 04 02:22:17.778697 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:17.778673 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-8cf267-6ccbff695f-d6sz7"] Nov 04 02:22:18.614985 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:18.614954 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e429a663-e33a-4104-baf1-9b208d58ab22" path="/var/lib/kubelet/pods/e429a663-e33a-4104-baf1-9b208d58ab22/volumes" Nov 04 02:22:27.954097 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:27.954026 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf"] Nov 04 02:22:27.954538 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:27.954260 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerName="istio-proxy" containerID="cri-o://52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2" gracePeriod=30 Nov 04 02:22:30.139943 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:30.139908 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr"] Nov 04 02:22:30.140364 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:30.140172 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" podUID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" containerName="istio-proxy" containerID="cri-o://92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de" gracePeriod=30 Nov 04 02:22:32.678238 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:32.678199 5219 patch_prober.go:29] interesting pod/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 02:22:32.678692 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:32.678262 5219 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 02:22:33.200163 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.200135 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:22:33.234536 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.234481 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-certs\") pod \"5f8a844c-2007-42cc-b274-dab96d24e8bd\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " Nov 04 02:22:33.234536 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.234535 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-envoy\") pod \"5f8a844c-2007-42cc-b274-dab96d24e8bd\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " Nov 04 02:22:33.234695 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.234559 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f8a844c-2007-42cc-b274-dab96d24e8bd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f8a844c-2007-42cc-b274-dab96d24e8bd-istiod-ca-cert\") pod \"5f8a844c-2007-42cc-b274-dab96d24e8bd\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " Nov 04 02:22:33.234695 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.234599 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-kube-api-access-9r62d\" (UniqueName: \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-kube-api-access-9r62d\") pod \"5f8a844c-2007-42cc-b274-dab96d24e8bd\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " Nov 04 02:22:33.234695 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.234639 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-token\" (UniqueName: \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-token\") pod \"5f8a844c-2007-42cc-b274-dab96d24e8bd\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " Nov 04 02:22:33.234695 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.234685 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-podinfo\") pod \"5f8a844c-2007-42cc-b274-dab96d24e8bd\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " Nov 04 02:22:33.234896 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.234723 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-credential-socket\") pod \"5f8a844c-2007-42cc-b274-dab96d24e8bd\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " Nov 04 02:22:33.234896 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.234753 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-socket\") pod \"5f8a844c-2007-42cc-b274-dab96d24e8bd\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " Nov 04 02:22:33.234896 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.234771 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-certs" pod "5f8a844c-2007-42cc-b274-dab96d24e8bd" (UID: "5f8a844c-2007-42cc-b274-dab96d24e8bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:33.235060 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.235000 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-credential-socket" pod "5f8a844c-2007-42cc-b274-dab96d24e8bd" (UID: "5f8a844c-2007-42cc-b274-dab96d24e8bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:33.235060 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.235005 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f8a844c-2007-42cc-b274-dab96d24e8bd-istiod-ca-cert" pod "5f8a844c-2007-42cc-b274-dab96d24e8bd" (UID: "5f8a844c-2007-42cc-b274-dab96d24e8bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:22:33.235060 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.235012 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-data\") pod \"5f8a844c-2007-42cc-b274-dab96d24e8bd\" (UID: \"5f8a844c-2007-42cc-b274-dab96d24e8bd\") " Nov 04 02:22:33.235206 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.235135 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-socket" pod "5f8a844c-2007-42cc-b274-dab96d24e8bd" (UID: "5f8a844c-2007-42cc-b274-dab96d24e8bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:33.235206 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.235164 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-data" pod "5f8a844c-2007-42cc-b274-dab96d24e8bd" (UID: "5f8a844c-2007-42cc-b274-dab96d24e8bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:33.235494 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.235426 5219 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-data\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:33.235494 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.235447 5219 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:33.235494 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.235462 5219 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f8a844c-2007-42cc-b274-dab96d24e8bd-istiod-ca-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:33.235494 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.235477 5219 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-credential-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:33.235494 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.235491 5219 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-workload-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:33.236926 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.236898 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-kube-api-access-9r62d" pod "5f8a844c-2007-42cc-b274-dab96d24e8bd" (UID: "5f8a844c-2007-42cc-b274-dab96d24e8bd"). InnerVolumeSpecName "kube-api-access-9r62d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:22:33.237066 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.237034 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-token" pod "5f8a844c-2007-42cc-b274-dab96d24e8bd" (UID: "5f8a844c-2007-42cc-b274-dab96d24e8bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:22:33.237066 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.237043 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-envoy" pod "5f8a844c-2007-42cc-b274-dab96d24e8bd" (UID: "5f8a844c-2007-42cc-b274-dab96d24e8bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:33.237239 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.237114 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-podinfo" pod "5f8a844c-2007-42cc-b274-dab96d24e8bd" (UID: "5f8a844c-2007-42cc-b274-dab96d24e8bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:22:33.335970 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.335936 5219 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-envoy\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:33.335970 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.335969 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r62d\" (UniqueName: \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-kube-api-access-9r62d\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:33.336172 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.335984 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:33.336172 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.335992 5219 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f8a844c-2007-42cc-b274-dab96d24e8bd-istio-podinfo\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:33.723581 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.723278 5219 generic.go:356] "Generic (PLEG): container finished" podID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerID="52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2" exitCode=0 Nov 04 02:22:33.723581 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.723354 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" Nov 04 02:22:33.723581 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.723377 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" event={"ID":"5f8a844c-2007-42cc-b274-dab96d24e8bd","Type":"ContainerDied","Data":"52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2"} Nov 04 02:22:33.723581 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.723425 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf" event={"ID":"5f8a844c-2007-42cc-b274-dab96d24e8bd","Type":"ContainerDied","Data":"00ebaba4c22fb65cec12cbfb9cca95b5ce211cc81a8d6a363a1e63e36cd787d5"} Nov 04 02:22:33.723581 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.723452 5219 scope.go:122] "RemoveContainer" containerID="52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2" Nov 04 02:22:33.734481 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.734459 5219 scope.go:122] "RemoveContainer" containerID="52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2" Nov 04 02:22:33.734776 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:22:33.734736 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2\": container with ID starting with 52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2 not found: ID does not exist" containerID="52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2" Nov 04 02:22:33.734883 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.734775 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2"} err="failed to get container status \"52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2\": rpc error: code = NotFound desc = could not find container \"52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2\": container with ID starting with 52130cdf57b2a98d92ced1f19e3d00ede6175de95a34522c2bf97e7878e5c9d2 not found: ID does not exist" Nov 04 02:22:33.886456 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.886415 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf"] Nov 04 02:22:33.937168 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:33.936375 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-8cf267-openshift-default-7cb975b44c-8l5nf"] Nov 04 02:22:34.616327 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:34.616280 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" path="/var/lib/kubelet/pods/5f8a844c-2007-42cc-b274-dab96d24e8bd/volumes" Nov 04 02:22:34.737611 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:34.737588 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:22:34.749588 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:34.749569 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kbkqw_1b432d50-c888-420f-980f-4e7dd474a44a/ovn-acl-logging/0.log" Nov 04 02:22:35.390091 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.390066 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:22:35.474172 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474143 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-podinfo\") pod \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " Nov 04 02:22:35.474337 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474189 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-envoy\") pod \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " Nov 04 02:22:35.474337 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474210 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-certs\") pod \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " Nov 04 02:22:35.474337 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474322 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-kube-api-access-qwp9b\" (UniqueName: \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-kube-api-access-qwp9b\") pod \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " Nov 04 02:22:35.474505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474386 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-token\" (UniqueName: \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-token\") pod \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " Nov 04 02:22:35.474505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474427 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-credential-socket\") pod \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " Nov 04 02:22:35.474505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474458 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istiod-ca-cert\") pod \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " Nov 04 02:22:35.474505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474491 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-data\") pod \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " Nov 04 02:22:35.474702 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474541 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-certs" pod "0f542f33-eb42-4bff-a4e4-51a9c87a6265" (UID: "0f542f33-eb42-4bff-a4e4-51a9c87a6265"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:35.474702 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474548 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-socket\") pod \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\" (UID: \"0f542f33-eb42-4bff-a4e4-51a9c87a6265\") " Nov 04 02:22:35.474870 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474842 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-data" pod "0f542f33-eb42-4bff-a4e4-51a9c87a6265" (UID: "0f542f33-eb42-4bff-a4e4-51a9c87a6265"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:35.474930 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474873 5219 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:35.474930 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474878 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istiod-ca-cert" pod "0f542f33-eb42-4bff-a4e4-51a9c87a6265" (UID: "0f542f33-eb42-4bff-a4e4-51a9c87a6265"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:22:35.475196 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.474924 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-credential-socket" pod "0f542f33-eb42-4bff-a4e4-51a9c87a6265" (UID: "0f542f33-eb42-4bff-a4e4-51a9c87a6265"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:35.475196 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.475053 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-socket" pod "0f542f33-eb42-4bff-a4e4-51a9c87a6265" (UID: "0f542f33-eb42-4bff-a4e4-51a9c87a6265"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:35.476665 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.476642 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-token" pod "0f542f33-eb42-4bff-a4e4-51a9c87a6265" (UID: "0f542f33-eb42-4bff-a4e4-51a9c87a6265"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:22:35.476771 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.476755 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-kube-api-access-qwp9b" pod "0f542f33-eb42-4bff-a4e4-51a9c87a6265" (UID: "0f542f33-eb42-4bff-a4e4-51a9c87a6265"). InnerVolumeSpecName "kube-api-access-qwp9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:22:35.476937 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.476914 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-envoy" pod "0f542f33-eb42-4bff-a4e4-51a9c87a6265" (UID: "0f542f33-eb42-4bff-a4e4-51a9c87a6265"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:35.476937 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.476921 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-podinfo" pod "0f542f33-eb42-4bff-a4e4-51a9c87a6265" (UID: "0f542f33-eb42-4bff-a4e4-51a9c87a6265"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:22:35.575594 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.575564 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwp9b\" (UniqueName: \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-kube-api-access-qwp9b\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:35.575594 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.575593 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:35.575870 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.575605 5219 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-credential-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:35.575870 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.575619 5219 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istiod-ca-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:35.575870 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.575631 5219 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-data\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:35.575870 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.575641 5219 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-workload-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:35.575870 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.575668 5219 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-podinfo\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:35.575870 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.575680 5219 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f542f33-eb42-4bff-a4e4-51a9c87a6265-istio-envoy\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:35.740962 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.740870 5219 generic.go:356] "Generic (PLEG): container finished" podID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" containerID="92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de" exitCode=0 Nov 04 02:22:35.740962 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.740922 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" Nov 04 02:22:35.741535 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.740957 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" event={"ID":"0f542f33-eb42-4bff-a4e4-51a9c87a6265","Type":"ContainerDied","Data":"92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de"} Nov 04 02:22:35.741535 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.741006 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr" event={"ID":"0f542f33-eb42-4bff-a4e4-51a9c87a6265","Type":"ContainerDied","Data":"186dcad669814c438461b86b42ac41ef116aa5516177edff3359bc3335345569"} Nov 04 02:22:35.741535 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.741032 5219 scope.go:122] "RemoveContainer" containerID="92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de" Nov 04 02:22:35.750099 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.750082 5219 scope.go:122] "RemoveContainer" containerID="92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de" Nov 04 02:22:35.750410 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:22:35.750390 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de\": container with ID starting with 92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de not found: ID does not exist" containerID="92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de" Nov 04 02:22:35.750450 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.750420 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de"} err="failed to get container status \"92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de\": rpc error: code = NotFound desc = could not find container \"92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de\": container with ID starting with 92de372f2a896f19cab0506bc997c7511bb1a641331156ce1ade914e9ba738de not found: ID does not exist" Nov 04 02:22:35.906212 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.906178 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr"] Nov 04 02:22:35.912074 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:35.912049 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a27ba-openshift-default-74b449ccf5-8rczr"] Nov 04 02:22:36.613867 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:36.613840 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" path="/var/lib/kubelet/pods/0f542f33-eb42-4bff-a4e4-51a9c87a6265/volumes" Nov 04 02:22:37.726404 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:37.726368 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm"] Nov 04 02:22:37.726861 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:37.726562 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" containerID="cri-o://eb01a63c174f5013422f64b738d2a2bfa4c2f503353d877465383b8396990e50" gracePeriod=30 Nov 04 02:22:38.929799 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:22:38.929763 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:22:40.778742 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.778710 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx"] Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779031 5219 cpu_manager.go:414] "containerMap: removing container" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerName="istio-proxy" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779042 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerName="istio-proxy" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779065 5219 cpu_manager.go:414] "containerMap: removing container" podUID="57cdc8cd-3b59-4081-a93d-1a42043ff046" containerName="payload-pre-processing" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779073 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="57cdc8cd-3b59-4081-a93d-1a42043ff046" containerName="payload-pre-processing" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779081 5219 cpu_manager.go:414] "containerMap: removing container" podUID="10c85d5c-deac-46bc-88bf-856ed8f3aabc" containerName="revoke-keys" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779086 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10c85d5c-deac-46bc-88bf-856ed8f3aabc" containerName="revoke-keys" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779095 5219 cpu_manager.go:414] "containerMap: removing container" podUID="e429a663-e33a-4104-baf1-9b208d58ab22" containerName="payload-pre-processing" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779100 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e429a663-e33a-4104-baf1-9b208d58ab22" containerName="payload-pre-processing" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779111 5219 cpu_manager.go:414] "containerMap: removing container" podUID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" containerName="istio-proxy" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779115 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" containerName="istio-proxy" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779122 5219 cpu_manager.go:414] "containerMap: removing container" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerName="istio-proxy" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779127 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerName="istio-proxy" Nov 04 02:22:40.779137 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779137 5219 cpu_manager.go:414] "containerMap: removing container" podUID="77ca6e9c-edc4-4d12-a75e-96c056086871" containerName="payload-processing" Nov 04 02:22:40.779520 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779144 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77ca6e9c-edc4-4d12-a75e-96c056086871" containerName="payload-processing" Nov 04 02:22:40.779520 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779214 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ef9f4e1-ad1c-4578-b9aa-dd226508698a" containerName="istio-proxy" Nov 04 02:22:40.779520 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779222 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="57cdc8cd-3b59-4081-a93d-1a42043ff046" containerName="payload-pre-processing" Nov 04 02:22:40.779520 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779229 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="10c85d5c-deac-46bc-88bf-856ed8f3aabc" containerName="revoke-keys" Nov 04 02:22:40.779520 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779234 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="e429a663-e33a-4104-baf1-9b208d58ab22" containerName="payload-pre-processing" Nov 04 02:22:40.779520 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779240 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f542f33-eb42-4bff-a4e4-51a9c87a6265" containerName="istio-proxy" Nov 04 02:22:40.779520 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779245 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f8a844c-2007-42cc-b274-dab96d24e8bd" containerName="istio-proxy" Nov 04 02:22:40.779520 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.779251 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="77ca6e9c-edc4-4d12-a75e-96c056086871" containerName="payload-processing" Nov 04 02:22:40.783575 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.783558 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.823560 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.823523 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-certs\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.823560 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.823564 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-envoy\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.823779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.823581 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istiod-ca-cert\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.823779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.823694 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-token\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.823779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.823725 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-data\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.823779 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.823753 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8tjx\" (UniqueName: \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-kube-api-access-m8tjx\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.823947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.823821 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-credential-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.823947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.823862 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.823947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.823891 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-podinfo\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.873727 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.873694 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx"] Nov 04 02:22:40.925189 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925156 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-token\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925400 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925198 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-data\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925400 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925230 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8tjx\" (UniqueName: \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-kube-api-access-m8tjx\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925528 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925396 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-credential-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925528 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925454 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925528 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925498 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-podinfo\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925682 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925579 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-certs\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925682 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925624 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-envoy\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925682 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925650 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istiod-ca-cert\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925682 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925657 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-data\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925682 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925674 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-credential-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925923 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925773 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-socket\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.925923 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.925882 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-certs\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.926253 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.926228 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istiod-ca-cert\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.927952 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.927931 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-envoy\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.928066 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.928057 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-podinfo\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.986568 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.986529 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-token\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:40.986699 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:40.986644 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8tjx\" (UniqueName: \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-kube-api-access-m8tjx\") pod \"e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:41.096558 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:41.096470 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:41.527506 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:41.527473 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx"] Nov 04 02:22:41.530542 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:22:41.530503 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f17096_e509_4a39_a6ca_7c6b39c8abde.slice/crio-5340f6353c94848e92ccfacb7d98a5b6042162ea9e92e953df605f4e75c77e94 WatchSource:0}: Error finding container 5340f6353c94848e92ccfacb7d98a5b6042162ea9e92e953df605f4e75c77e94: Status 404 returned error can't find the container with id 5340f6353c94848e92ccfacb7d98a5b6042162ea9e92e953df605f4e75c77e94 Nov 04 02:22:41.532611 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:41.532574 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:22:41.532710 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:41.532641 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:22:41.532710 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:41.532691 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:22:41.770476 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:41.770438 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" event={"ID":"e1f17096-e509-4a39-a6ca-7c6b39c8abde","Type":"ContainerStarted","Data":"5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa"} Nov 04 02:22:41.770654 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:41.770495 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" event={"ID":"e1f17096-e509-4a39-a6ca-7c6b39c8abde","Type":"ContainerStarted","Data":"5340f6353c94848e92ccfacb7d98a5b6042162ea9e92e953df605f4e75c77e94"} Nov 04 02:22:41.891842 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:41.891720 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" podStartSLOduration=1.891699791 podStartE2EDuration="1.891699791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:22:41.8904199 +0000 UTC m=+907.378928601" watchObservedRunningTime="2026-11-04 02:22:41.891699791 +0000 UTC m=+907.380208495" Nov 04 02:22:42.097058 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:42.097022 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:42.098385 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:42.098359 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 02:22:42.098511 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:42.098407 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 02:22:42.776946 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:42.776914 5219 generic.go:356] "Generic (PLEG): container finished" podID="32e86ed3-6262-455d-a68b-5fb509188cab" containerID="eb01a63c174f5013422f64b738d2a2bfa4c2f503353d877465383b8396990e50" exitCode=0 Nov 04 02:22:42.777087 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:42.776984 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" event={"ID":"32e86ed3-6262-455d-a68b-5fb509188cab","Type":"ContainerDied","Data":"eb01a63c174f5013422f64b738d2a2bfa4c2f503353d877465383b8396990e50"} Nov 04 02:22:43.097534 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.097439 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 02:22:43.097938 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.097521 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 02:22:43.413187 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.413160 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:22:43.454727 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.454693 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-credential-socket\") pod \"32e86ed3-6262-455d-a68b-5fb509188cab\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " Nov 04 02:22:43.454948 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.454771 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-socket\") pod \"32e86ed3-6262-455d-a68b-5fb509188cab\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " Nov 04 02:22:43.454948 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.454841 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-envoy\") pod \"32e86ed3-6262-455d-a68b-5fb509188cab\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " Nov 04 02:22:43.454948 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.454879 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-certs\") pod \"32e86ed3-6262-455d-a68b-5fb509188cab\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " Nov 04 02:22:43.454948 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.454904 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-istio-token\" (UniqueName: \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-istio-token\") pod \"32e86ed3-6262-455d-a68b-5fb509188cab\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " Nov 04 02:22:43.455146 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.454949 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-kube-api-access-k2d9h\" (UniqueName: \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-kube-api-access-k2d9h\") pod \"32e86ed3-6262-455d-a68b-5fb509188cab\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " Nov 04 02:22:43.455146 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.454983 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/32e86ed3-6262-455d-a68b-5fb509188cab-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32e86ed3-6262-455d-a68b-5fb509188cab-istiod-ca-cert\") pod \"32e86ed3-6262-455d-a68b-5fb509188cab\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " Nov 04 02:22:43.455146 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455032 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/32e86ed3-6262-455d-a68b-5fb509188cab-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32e86ed3-6262-455d-a68b-5fb509188cab-istio-podinfo\") pod \"32e86ed3-6262-455d-a68b-5fb509188cab\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " Nov 04 02:22:43.455146 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455109 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-data\") pod \"32e86ed3-6262-455d-a68b-5fb509188cab\" (UID: \"32e86ed3-6262-455d-a68b-5fb509188cab\") " Nov 04 02:22:43.455357 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455005 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-credential-socket" pod "32e86ed3-6262-455d-a68b-5fb509188cab" (UID: "32e86ed3-6262-455d-a68b-5fb509188cab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:43.455357 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455332 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32e86ed3-6262-455d-a68b-5fb509188cab-istiod-ca-cert" pod "32e86ed3-6262-455d-a68b-5fb509188cab" (UID: "32e86ed3-6262-455d-a68b-5fb509188cab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:22:43.455357 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455059 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-socket" pod "32e86ed3-6262-455d-a68b-5fb509188cab" (UID: "32e86ed3-6262-455d-a68b-5fb509188cab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:43.455357 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455128 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-certs" pod "32e86ed3-6262-455d-a68b-5fb509188cab" (UID: "32e86ed3-6262-455d-a68b-5fb509188cab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:43.455566 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455492 5219 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32e86ed3-6262-455d-a68b-5fb509188cab-istiod-ca-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:43.455566 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455514 5219 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-credential-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:43.455566 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455528 5219 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:43.455566 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455542 5219 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-workload-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:43.455566 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.455542 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-data" pod "32e86ed3-6262-455d-a68b-5fb509188cab" (UID: "32e86ed3-6262-455d-a68b-5fb509188cab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:43.457939 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.457912 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32e86ed3-6262-455d-a68b-5fb509188cab-istio-podinfo" pod "32e86ed3-6262-455d-a68b-5fb509188cab" (UID: "32e86ed3-6262-455d-a68b-5fb509188cab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:22:43.457939 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.457918 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-kube-api-access-k2d9h" pod "32e86ed3-6262-455d-a68b-5fb509188cab" (UID: "32e86ed3-6262-455d-a68b-5fb509188cab"). InnerVolumeSpecName "kube-api-access-k2d9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:22:43.458107 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.457956 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-istio-token" pod "32e86ed3-6262-455d-a68b-5fb509188cab" (UID: "32e86ed3-6262-455d-a68b-5fb509188cab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:22:43.458107 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.458006 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-envoy" pod "32e86ed3-6262-455d-a68b-5fb509188cab" (UID: "32e86ed3-6262-455d-a68b-5fb509188cab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:22:43.556864 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.556830 5219 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-envoy\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:43.556864 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.556859 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:43.556864 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.556870 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2d9h\" (UniqueName: \"kubernetes.io/projected/32e86ed3-6262-455d-a68b-5fb509188cab-kube-api-access-k2d9h\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:43.557162 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.556880 5219 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32e86ed3-6262-455d-a68b-5fb509188cab-istio-podinfo\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:43.557162 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.556889 5219 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32e86ed3-6262-455d-a68b-5fb509188cab-istio-data\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:22:43.783356 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.783315 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" event={"ID":"32e86ed3-6262-455d-a68b-5fb509188cab","Type":"ContainerDied","Data":"57d3154c87194819764eb058288fd8bab1b3ce10baeee734740e04f392339d6d"} Nov 04 02:22:43.783356 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.783348 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm" Nov 04 02:22:43.783627 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.783380 5219 scope.go:122] "RemoveContainer" containerID="eb01a63c174f5013422f64b738d2a2bfa4c2f503353d877465383b8396990e50" Nov 04 02:22:43.953046 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.953010 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm"] Nov 04 02:22:43.957546 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:43.957520 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-j8dtm"] Nov 04 02:22:44.097521 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:44.097440 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 02:22:44.097521 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:44.097503 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 02:22:44.616673 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:44.615366 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" path="/var/lib/kubelet/pods/32e86ed3-6262-455d-a68b-5fb509188cab/volumes" Nov 04 02:22:45.097050 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:45.097018 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 02:22:45.097349 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:45.097093 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 02:22:46.097700 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:46.097673 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 02:22:46.098112 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:46.097745 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 02:22:47.097303 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:47.097242 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 02:22:47.097509 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:47.097324 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 02:22:48.097759 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:48.097723 5219 patch_prober.go:29] interesting pod/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 02:22:48.098151 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:48.097781 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 02:22:49.101494 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:49.101467 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:49.101954 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:49.101886 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:49.102653 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:49.102634 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:22:54.856468 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:54.856435 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh"] Nov 04 02:22:54.905890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:22:54.905855 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb"] Nov 04 02:23:01.967083 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:01.967047 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:23:08.930906 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:23:08.930872 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:23:09.876014 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:09.875963 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" podUID="9d1de1f7-344c-4460-97aa-0c3bece4f57a" containerName="main" containerID="cri-o://113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67" gracePeriod=45 Nov 04 02:23:09.926268 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:09.926233 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" podUID="7ff17d7d-a35e-4fda-bd78-61d26642f720" containerName="main" containerID="cri-o://da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332" gracePeriod=45 Nov 04 02:23:10.017500 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.017468 5219 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" podUID="7ff17d7d-a35e-4fda-bd78-61d26642f720" containerName="main" probeResult="failure" output="Get \"https://10.134.0.34:8000/ready\": dial tcp 10.134.0.34:8000: connect: connection refused" Nov 04 02:23:10.035738 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.035713 5219 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" podUID="9d1de1f7-344c-4460-97aa-0c3bece4f57a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": dial tcp 10.134.0.41:8000: connect: connection refused" Nov 04 02:23:10.195325 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.195300 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:23:10.213616 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.213596 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320086 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-home\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-home\") pod \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320133 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tmp-dir\") pod \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320163 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-dshm\") pod \"7ff17d7d-a35e-4fda-bd78-61d26642f720\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320203 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ff17d7d-a35e-4fda-bd78-61d26642f720-kube-api-access-8r2cx\" (UniqueName: \"kubernetes.io/projected/7ff17d7d-a35e-4fda-bd78-61d26642f720-kube-api-access-8r2cx\") pod \"7ff17d7d-a35e-4fda-bd78-61d26642f720\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320232 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-home\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-home\") pod \"7ff17d7d-a35e-4fda-bd78-61d26642f720\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320259 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-tmp-dir\") pod \"7ff17d7d-a35e-4fda-bd78-61d26642f720\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320302 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-model-cache\") pod \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320340 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7ff17d7d-a35e-4fda-bd78-61d26642f720-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ff17d7d-a35e-4fda-bd78-61d26642f720-tls-certs\") pod \"7ff17d7d-a35e-4fda-bd78-61d26642f720\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320366 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-dshm\") pod \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320393 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-model-cache\") pod \"7ff17d7d-a35e-4fda-bd78-61d26642f720\" (UID: \"7ff17d7d-a35e-4fda-bd78-61d26642f720\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320484 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d1de1f7-344c-4460-97aa-0c3bece4f57a-kube-api-access-hjdbl\" (UniqueName: \"kubernetes.io/projected/9d1de1f7-344c-4460-97aa-0c3bece4f57a-kube-api-access-hjdbl\") pod \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.320589 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tls-certs\") pod \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\" (UID: \"9d1de1f7-344c-4460-97aa-0c3bece4f57a\") " Nov 04 02:23:10.321251 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.321149 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-home" pod "9d1de1f7-344c-4460-97aa-0c3bece4f57a" (UID: "9d1de1f7-344c-4460-97aa-0c3bece4f57a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:10.322037 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.321365 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tmp-dir" pod "9d1de1f7-344c-4460-97aa-0c3bece4f57a" (UID: "9d1de1f7-344c-4460-97aa-0c3bece4f57a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:10.322575 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.322319 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-model-cache" pod "9d1de1f7-344c-4460-97aa-0c3bece4f57a" (UID: "9d1de1f7-344c-4460-97aa-0c3bece4f57a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:10.323394 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.323152 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-model-cache" pod "7ff17d7d-a35e-4fda-bd78-61d26642f720" (UID: "7ff17d7d-a35e-4fda-bd78-61d26642f720"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:10.323394 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.323364 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-tmp-dir" pod "7ff17d7d-a35e-4fda-bd78-61d26642f720" (UID: "7ff17d7d-a35e-4fda-bd78-61d26642f720"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:10.323394 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.323382 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-home" pod "7ff17d7d-a35e-4fda-bd78-61d26642f720" (UID: "7ff17d7d-a35e-4fda-bd78-61d26642f720"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:10.324244 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.324218 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-dshm" pod "7ff17d7d-a35e-4fda-bd78-61d26642f720" (UID: "7ff17d7d-a35e-4fda-bd78-61d26642f720"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:10.325975 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.325948 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-dshm" pod "9d1de1f7-344c-4460-97aa-0c3bece4f57a" (UID: "9d1de1f7-344c-4460-97aa-0c3bece4f57a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:10.326665 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.326636 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d1de1f7-344c-4460-97aa-0c3bece4f57a-kube-api-access-hjdbl" pod "9d1de1f7-344c-4460-97aa-0c3bece4f57a" (UID: "9d1de1f7-344c-4460-97aa-0c3bece4f57a"). InnerVolumeSpecName "kube-api-access-hjdbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:23:10.327480 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.327441 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tls-certs" pod "9d1de1f7-344c-4460-97aa-0c3bece4f57a" (UID: "9d1de1f7-344c-4460-97aa-0c3bece4f57a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:23:10.327620 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.327596 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff17d7d-a35e-4fda-bd78-61d26642f720-kube-api-access-8r2cx" pod "7ff17d7d-a35e-4fda-bd78-61d26642f720" (UID: "7ff17d7d-a35e-4fda-bd78-61d26642f720"). InnerVolumeSpecName "kube-api-access-8r2cx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:23:10.328140 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.328114 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff17d7d-a35e-4fda-bd78-61d26642f720-tls-certs" pod "7ff17d7d-a35e-4fda-bd78-61d26642f720" (UID: "7ff17d7d-a35e-4fda-bd78-61d26642f720"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:23:10.422016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.421949 5219 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-home\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.421971 5219 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tmp-dir\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.421981 5219 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-dshm\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.421990 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r2cx\" (UniqueName: \"kubernetes.io/projected/7ff17d7d-a35e-4fda-bd78-61d26642f720-kube-api-access-8r2cx\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.422000 5219 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-home\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.422007 5219 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-tmp-dir\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.422015 5219 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-model-cache\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422352 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.422024 5219 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ff17d7d-a35e-4fda-bd78-61d26642f720-tls-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422352 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.422031 5219 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d1de1f7-344c-4460-97aa-0c3bece4f57a-dshm\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422352 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.422040 5219 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ff17d7d-a35e-4fda-bd78-61d26642f720-model-cache\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422352 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.422048 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjdbl\" (UniqueName: \"kubernetes.io/projected/9d1de1f7-344c-4460-97aa-0c3bece4f57a-kube-api-access-hjdbl\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.422352 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.422056 5219 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d1de1f7-344c-4460-97aa-0c3bece4f57a-tls-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:10.916920 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.916886 5219 generic.go:356] "Generic (PLEG): container finished" podID="7ff17d7d-a35e-4fda-bd78-61d26642f720" containerID="da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332" exitCode=0 Nov 04 02:23:10.917104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.916946 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" Nov 04 02:23:10.917104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.916965 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" event={"ID":"7ff17d7d-a35e-4fda-bd78-61d26642f720","Type":"ContainerDied","Data":"da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332"} Nov 04 02:23:10.917104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.917013 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb" event={"ID":"7ff17d7d-a35e-4fda-bd78-61d26642f720","Type":"ContainerDied","Data":"7f6a2410f21459a6f782b1a1cab2de18be9cfb1b411e8a3bed9f5e6130a246a2"} Nov 04 02:23:10.917104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.917039 5219 scope.go:122] "RemoveContainer" containerID="da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332" Nov 04 02:23:10.918800 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.918775 5219 generic.go:356] "Generic (PLEG): container finished" podID="9d1de1f7-344c-4460-97aa-0c3bece4f57a" containerID="113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67" exitCode=0 Nov 04 02:23:10.918983 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.918806 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" event={"ID":"9d1de1f7-344c-4460-97aa-0c3bece4f57a","Type":"ContainerDied","Data":"113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67"} Nov 04 02:23:10.918983 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.918838 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" Nov 04 02:23:10.918983 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.918842 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh" event={"ID":"9d1de1f7-344c-4460-97aa-0c3bece4f57a","Type":"ContainerDied","Data":"36f6f5cca8af193f8f6693d97f0b88618512ade490e9b814cfadfeeb0e31971b"} Nov 04 02:23:10.925913 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.925897 5219 scope.go:122] "RemoveContainer" containerID="da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332" Nov 04 02:23:10.926186 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:23:10.926165 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332\": container with ID starting with da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332 not found: ID does not exist" containerID="da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332" Nov 04 02:23:10.926232 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.926193 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332"} err="failed to get container status \"da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332\": rpc error: code = NotFound desc = could not find container \"da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332\": container with ID starting with da1a086b5faa31292171952cd70a0f46b88c3bfd317fadbfd4b2beccd9894332 not found: ID does not exist" Nov 04 02:23:10.926232 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.926209 5219 scope.go:122] "RemoveContainer" containerID="113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67" Nov 04 02:23:10.936120 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.936104 5219 scope.go:122] "RemoveContainer" containerID="113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67" Nov 04 02:23:10.936472 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:23:10.936455 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67\": container with ID starting with 113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67 not found: ID does not exist" containerID="113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67" Nov 04 02:23:10.936522 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:10.936479 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67"} err="failed to get container status \"113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67\": rpc error: code = NotFound desc = could not find container \"113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67\": container with ID starting with 113db688c283ede7089e05efa46494bb1ae454a86ad708784b8c5a1d87a20d67 not found: ID does not exist" Nov 04 02:23:11.080931 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:11.080906 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh"] Nov 04 02:23:11.085062 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:11.085045 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/distinct-w0-e34b54-kserve-76d54d79d6-826rh"] Nov 04 02:23:11.195772 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:11.195747 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb"] Nov 04 02:23:11.199192 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:11.199173 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e34b54/simulator-w0-e34b54-kserve-577bb5dcf4-g8jdb"] Nov 04 02:23:12.613265 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:12.613230 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7ff17d7d-a35e-4fda-bd78-61d26642f720" path="/var/lib/kubelet/pods/7ff17d7d-a35e-4fda-bd78-61d26642f720/volumes" Nov 04 02:23:12.613632 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:12.613597 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d1de1f7-344c-4460-97aa-0c3bece4f57a" path="/var/lib/kubelet/pods/9d1de1f7-344c-4460-97aa-0c3bece4f57a/volumes" Nov 04 02:23:24.342616 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.342580 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q"] Nov 04 02:23:24.343047 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.342893 5219 cpu_manager.go:414] "containerMap: removing container" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" Nov 04 02:23:24.343047 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.342903 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" Nov 04 02:23:24.343047 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.342922 5219 cpu_manager.go:414] "containerMap: removing container" podUID="7ff17d7d-a35e-4fda-bd78-61d26642f720" containerName="main" Nov 04 02:23:24.343047 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.342927 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ff17d7d-a35e-4fda-bd78-61d26642f720" containerName="main" Nov 04 02:23:24.343047 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.342934 5219 cpu_manager.go:414] "containerMap: removing container" podUID="9d1de1f7-344c-4460-97aa-0c3bece4f57a" containerName="main" Nov 04 02:23:24.343047 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.342939 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d1de1f7-344c-4460-97aa-0c3bece4f57a" containerName="main" Nov 04 02:23:24.343047 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.343001 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ff17d7d-a35e-4fda-bd78-61d26642f720" containerName="main" Nov 04 02:23:24.343047 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.343009 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d1de1f7-344c-4460-97aa-0c3bece4f57a" containerName="main" Nov 04 02:23:24.343047 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.343017 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="32e86ed3-6262-455d-a68b-5fb509188cab" containerName="istio-proxy" Nov 04 02:23:24.347253 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.347236 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:24.434434 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.434410 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-740b5291-zrc6q\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:24.434540 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.434451 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvtdb\" (UniqueName: \"kubernetes.io/projected/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-kube-api-access-mvtdb\") pod \"maas-api-revoke-sub-740b5291-zrc6q\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:24.434584 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.434549 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-740b5291-zrc6q\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:24.452300 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.452266 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bvs2z\"" Nov 04 02:23:24.452401 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.452314 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 02:23:24.453940 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.453920 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q"] Nov 04 02:23:24.535424 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.535395 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-740b5291-zrc6q\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:24.535523 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.535430 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvtdb\" (UniqueName: \"kubernetes.io/projected/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-kube-api-access-mvtdb\") pod \"maas-api-revoke-sub-740b5291-zrc6q\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:24.535523 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.535471 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-740b5291-zrc6q\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:24.535931 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.535915 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-740b5291-zrc6q\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:24.537798 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.537781 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-740b5291-zrc6q\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:24.595433 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.595379 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvtdb\" (UniqueName: \"kubernetes.io/projected/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-kube-api-access-mvtdb\") pod \"maas-api-revoke-sub-740b5291-zrc6q\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:24.659344 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:24.659321 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:25.030885 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:25.030858 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q"] Nov 04 02:23:25.034023 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:23:25.033995 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68b0ce8_4f44_4abd_b9f9_869c1632aa5f.slice/crio-a9a865a62120a2396d08ffe4402e70b6cfea55f75be8612bec9b333b1d7dd6fc WatchSource:0}: Error finding container a9a865a62120a2396d08ffe4402e70b6cfea55f75be8612bec9b333b1d7dd6fc: Status 404 returned error can't find the container with id a9a865a62120a2396d08ffe4402e70b6cfea55f75be8612bec9b333b1d7dd6fc Nov 04 02:23:25.478463 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:25.478429 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm"] Nov 04 02:23:25.499096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:25.499071 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k"] Nov 04 02:23:26.013830 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:26.013804 5219 generic.go:356] "Generic (PLEG): container finished" podID="a68b0ce8-4f44-4abd-b9f9-869c1632aa5f" containerID="d5635825b5c3a089e80935b114ab06fb5a7775653871b8432842758df35812ab" exitCode=0 Nov 04 02:23:26.013942 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:26.013891 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" event={"ID":"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f","Type":"ContainerDied","Data":"d5635825b5c3a089e80935b114ab06fb5a7775653871b8432842758df35812ab"} Nov 04 02:23:26.013942 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:26.013934 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" event={"ID":"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f","Type":"ContainerStarted","Data":"a9a865a62120a2396d08ffe4402e70b6cfea55f75be8612bec9b333b1d7dd6fc"} Nov 04 02:23:27.145037 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:27.145016 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:27.266711 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:27.266685 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-kube-api-access-mvtdb\" (UniqueName: \"kubernetes.io/projected/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-kube-api-access-mvtdb\") pod \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " Nov 04 02:23:27.266836 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:27.266806 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-openshift-ca\") pod \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " Nov 04 02:23:27.266903 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:27.266849 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-xks-ca\") pod \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\" (UID: \"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f\") " Nov 04 02:23:27.267173 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:27.267137 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-openshift-ca" pod "a68b0ce8-4f44-4abd-b9f9-869c1632aa5f" (UID: "a68b0ce8-4f44-4abd-b9f9-869c1632aa5f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:23:27.269180 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:27.269122 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-kube-api-access-mvtdb" pod "a68b0ce8-4f44-4abd-b9f9-869c1632aa5f" (UID: "a68b0ce8-4f44-4abd-b9f9-869c1632aa5f"). InnerVolumeSpecName "kube-api-access-mvtdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:23:27.270095 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:27.270073 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-xks-ca" pod "a68b0ce8-4f44-4abd-b9f9-869c1632aa5f" (UID: "a68b0ce8-4f44-4abd-b9f9-869c1632aa5f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:23:27.367436 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:27.367411 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-openshift-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:27.367436 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:27.367434 5219 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-maas-api-xks-ca\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:27.367557 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:27.367443 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvtdb\" (UniqueName: \"kubernetes.io/projected/a68b0ce8-4f44-4abd-b9f9-869c1632aa5f-kube-api-access-mvtdb\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:28.025062 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:28.025040 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" Nov 04 02:23:28.025216 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:28.025037 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q" event={"ID":"a68b0ce8-4f44-4abd-b9f9-869c1632aa5f","Type":"ContainerDied","Data":"a9a865a62120a2396d08ffe4402e70b6cfea55f75be8612bec9b333b1d7dd6fc"} Nov 04 02:23:28.025216 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:28.025161 5219 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9a865a62120a2396d08ffe4402e70b6cfea55f75be8612bec9b333b1d7dd6fc" Nov 04 02:23:28.700935 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:28.700907 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb"] Nov 04 02:23:35.011789 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:35.011758 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:23:38.076200 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:38.076151 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69"] Nov 04 02:23:38.076687 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:38.076490 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" podUID="5bef561c-0f3e-4b13-ac09-d70853b38226" containerName="istio-proxy" containerID="cri-o://791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe" gracePeriod=30 Nov 04 02:23:38.078177 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:38.078150 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx"] Nov 04 02:23:38.078463 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:38.078403 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" containerID="cri-o://5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa" gracePeriod=30 Nov 04 02:23:38.929601 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:23:38.929565 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:23:40.497676 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.497615 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" podUID="5cadf750-853e-48ef-8e72-fd6665a740dd" containerName="main" containerID="cri-o://1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9" gracePeriod=45 Nov 04 02:23:40.519677 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.519653 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" podUID="2db863a6-cf81-4135-8941-277b1e5974ca" containerName="main" containerID="cri-o://ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876" gracePeriod=45 Nov 04 02:23:40.758047 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.757997 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:23:40.784034 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.784010 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:23:40.880528 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880495 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-model-cache\") pod \"5cadf750-853e-48ef-8e72-fd6665a740dd\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " Nov 04 02:23:40.880528 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880528 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-home\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-home\") pod \"5cadf750-853e-48ef-8e72-fd6665a740dd\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " Nov 04 02:23:40.880712 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880555 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-tmp-dir\") pod \"2db863a6-cf81-4135-8941-277b1e5974ca\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " Nov 04 02:23:40.880712 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880573 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-model-cache\") pod \"2db863a6-cf81-4135-8941-277b1e5974ca\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " Nov 04 02:23:40.880712 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880598 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-dshm\") pod \"5cadf750-853e-48ef-8e72-fd6665a740dd\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " Nov 04 02:23:40.880712 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880623 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-tmp-dir\") pod \"5cadf750-853e-48ef-8e72-fd6665a740dd\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " Nov 04 02:23:40.880712 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880667 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-home\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-home\") pod \"2db863a6-cf81-4135-8941-277b1e5974ca\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " Nov 04 02:23:40.880956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880736 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5cadf750-853e-48ef-8e72-fd6665a740dd-kube-api-access-xz8bk\" (UniqueName: \"kubernetes.io/projected/5cadf750-853e-48ef-8e72-fd6665a740dd-kube-api-access-xz8bk\") pod \"5cadf750-853e-48ef-8e72-fd6665a740dd\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " Nov 04 02:23:40.880956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880774 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-dshm\") pod \"2db863a6-cf81-4135-8941-277b1e5974ca\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " Nov 04 02:23:40.880956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880754 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-model-cache" pod "5cadf750-853e-48ef-8e72-fd6665a740dd" (UID: "5cadf750-853e-48ef-8e72-fd6665a740dd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:40.880956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880852 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-model-cache" pod "2db863a6-cf81-4135-8941-277b1e5974ca" (UID: "2db863a6-cf81-4135-8941-277b1e5974ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:40.880956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880869 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5cadf750-853e-48ef-8e72-fd6665a740dd-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cadf750-853e-48ef-8e72-fd6665a740dd-tls-certs\") pod \"5cadf750-853e-48ef-8e72-fd6665a740dd\" (UID: \"5cadf750-853e-48ef-8e72-fd6665a740dd\") " Nov 04 02:23:40.880956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880884 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-home" pod "5cadf750-853e-48ef-8e72-fd6665a740dd" (UID: "5cadf750-853e-48ef-8e72-fd6665a740dd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:40.880956 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880918 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2db863a6-cf81-4135-8941-277b1e5974ca-kube-api-access-zh9t7\" (UniqueName: \"kubernetes.io/projected/2db863a6-cf81-4135-8941-277b1e5974ca-kube-api-access-zh9t7\") pod \"2db863a6-cf81-4135-8941-277b1e5974ca\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " Nov 04 02:23:40.881300 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.880962 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2db863a6-cf81-4135-8941-277b1e5974ca-tls-certs\" (UniqueName: \"kubernetes.io/secret/2db863a6-cf81-4135-8941-277b1e5974ca-tls-certs\") pod \"2db863a6-cf81-4135-8941-277b1e5974ca\" (UID: \"2db863a6-cf81-4135-8941-277b1e5974ca\") " Nov 04 02:23:40.881300 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.881014 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-tmp-dir" pod "5cadf750-853e-48ef-8e72-fd6665a740dd" (UID: "5cadf750-853e-48ef-8e72-fd6665a740dd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:40.881300 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.881225 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-home" pod "2db863a6-cf81-4135-8941-277b1e5974ca" (UID: "2db863a6-cf81-4135-8941-277b1e5974ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:40.881300 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.881278 5219 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-model-cache\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.881490 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.881305 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-tmp-dir" pod "2db863a6-cf81-4135-8941-277b1e5974ca" (UID: "2db863a6-cf81-4135-8941-277b1e5974ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:40.881490 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.881314 5219 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-home\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.881490 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.881328 5219 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-model-cache\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.881490 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.881344 5219 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-tmp-dir\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.883865 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.883841 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2db863a6-cf81-4135-8941-277b1e5974ca-kube-api-access-zh9t7" pod "2db863a6-cf81-4135-8941-277b1e5974ca" (UID: "2db863a6-cf81-4135-8941-277b1e5974ca"). InnerVolumeSpecName "kube-api-access-zh9t7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:23:40.883977 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.883863 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cadf750-853e-48ef-8e72-fd6665a740dd-kube-api-access-xz8bk" pod "5cadf750-853e-48ef-8e72-fd6665a740dd" (UID: "5cadf750-853e-48ef-8e72-fd6665a740dd"). InnerVolumeSpecName "kube-api-access-xz8bk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:23:40.883977 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.883872 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cadf750-853e-48ef-8e72-fd6665a740dd-tls-certs" pod "5cadf750-853e-48ef-8e72-fd6665a740dd" (UID: "5cadf750-853e-48ef-8e72-fd6665a740dd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:23:40.884087 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.883986 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2db863a6-cf81-4135-8941-277b1e5974ca-tls-certs" pod "2db863a6-cf81-4135-8941-277b1e5974ca" (UID: "2db863a6-cf81-4135-8941-277b1e5974ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:23:40.884087 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.884033 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-dshm" pod "5cadf750-853e-48ef-8e72-fd6665a740dd" (UID: "5cadf750-853e-48ef-8e72-fd6665a740dd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:40.884510 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.884490 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-dshm" pod "2db863a6-cf81-4135-8941-277b1e5974ca" (UID: "2db863a6-cf81-4135-8941-277b1e5974ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:40.982109 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.982086 5219 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-home\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.982109 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.982108 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz8bk\" (UniqueName: \"kubernetes.io/projected/5cadf750-853e-48ef-8e72-fd6665a740dd-kube-api-access-xz8bk\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.982274 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.982117 5219 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-dshm\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.982274 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.982126 5219 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cadf750-853e-48ef-8e72-fd6665a740dd-tls-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.982274 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.982134 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh9t7\" (UniqueName: \"kubernetes.io/projected/2db863a6-cf81-4135-8941-277b1e5974ca-kube-api-access-zh9t7\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.982274 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.982142 5219 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2db863a6-cf81-4135-8941-277b1e5974ca-tls-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.982274 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.982150 5219 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2db863a6-cf81-4135-8941-277b1e5974ca-tmp-dir\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:40.982274 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:40.982157 5219 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cadf750-853e-48ef-8e72-fd6665a740dd-dshm\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:41.091164 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.091076 5219 generic.go:356] "Generic (PLEG): container finished" podID="5cadf750-853e-48ef-8e72-fd6665a740dd" containerID="1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9" exitCode=0 Nov 04 02:23:41.091164 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.091140 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" Nov 04 02:23:41.091406 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.091178 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" event={"ID":"5cadf750-853e-48ef-8e72-fd6665a740dd","Type":"ContainerDied","Data":"1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9"} Nov 04 02:23:41.091406 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.091224 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm" event={"ID":"5cadf750-853e-48ef-8e72-fd6665a740dd","Type":"ContainerDied","Data":"757e22de47c2a15a82071f8308b19c19bf76d9e8b3af80ae92b4da4e511e849a"} Nov 04 02:23:41.091406 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.091246 5219 scope.go:122] "RemoveContainer" containerID="1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9" Nov 04 02:23:41.092643 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.092621 5219 generic.go:356] "Generic (PLEG): container finished" podID="2db863a6-cf81-4135-8941-277b1e5974ca" containerID="ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876" exitCode=0 Nov 04 02:23:41.092763 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.092651 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" event={"ID":"2db863a6-cf81-4135-8941-277b1e5974ca","Type":"ContainerDied","Data":"ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876"} Nov 04 02:23:41.092763 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.092677 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" Nov 04 02:23:41.092763 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.092682 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k" event={"ID":"2db863a6-cf81-4135-8941-277b1e5974ca","Type":"ContainerDied","Data":"ace944e21d1488cbb70e4e58b77910fb4dccf6c02346372e674a7f431dc5eee8"} Nov 04 02:23:41.100385 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.100148 5219 scope.go:122] "RemoveContainer" containerID="1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9" Nov 04 02:23:41.100671 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:23:41.100638 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9\": container with ID starting with 1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9 not found: ID does not exist" containerID="1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9" Nov 04 02:23:41.100729 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.100681 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9"} err="failed to get container status \"1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9\": rpc error: code = NotFound desc = could not find container \"1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9\": container with ID starting with 1a90f491588e8a22bb61da242bd2e94865461fa1406886dc23522cf2d0a730d9 not found: ID does not exist" Nov 04 02:23:41.100729 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.100703 5219 scope.go:122] "RemoveContainer" containerID="ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876" Nov 04 02:23:41.110102 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.110089 5219 scope.go:122] "RemoveContainer" containerID="ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876" Nov 04 02:23:41.110369 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:23:41.110353 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876\": container with ID starting with ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876 not found: ID does not exist" containerID="ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876" Nov 04 02:23:41.110423 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.110377 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876"} err="failed to get container status \"ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876\": rpc error: code = NotFound desc = could not find container \"ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876\": container with ID starting with ae47a35e89980fb8d7a24cf8e3e4e56ccd896d65f814c06e4b88beb3ab0d4876 not found: ID does not exist" Nov 04 02:23:41.253076 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.253053 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm"] Nov 04 02:23:41.257490 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.257471 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/distinct-w6-9adedd-kserve-595cdf8694-lnghm"] Nov 04 02:23:41.364921 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.364875 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k"] Nov 04 02:23:41.368909 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:41.368890 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-9adedd/simulator-w6-9adedd-kserve-76d7d6d898-8jj8k"] Nov 04 02:23:42.613327 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:42.613278 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2db863a6-cf81-4135-8941-277b1e5974ca" path="/var/lib/kubelet/pods/2db863a6-cf81-4135-8941-277b1e5974ca/volumes" Nov 04 02:23:42.613690 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:42.613654 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5cadf750-853e-48ef-8e72-fd6665a740dd" path="/var/lib/kubelet/pods/5cadf750-853e-48ef-8e72-fd6665a740dd/volumes" Nov 04 02:23:43.317350 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.317326 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:23:43.340927 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.340879 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:23:43.400177 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400155 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5bef561c-0f3e-4b13-ac09-d70853b38226-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bef561c-0f3e-4b13-ac09-d70853b38226-istiod-ca-cert\") pod \"5bef561c-0f3e-4b13-ac09-d70853b38226\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " Nov 04 02:23:43.400305 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400189 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-data\") pod \"5bef561c-0f3e-4b13-ac09-d70853b38226\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " Nov 04 02:23:43.400305 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400209 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-socket\") pod \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " Nov 04 02:23:43.400305 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400229 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-socket\") pod \"5bef561c-0f3e-4b13-ac09-d70853b38226\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " Nov 04 02:23:43.400451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400354 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-certs\") pod \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " Nov 04 02:23:43.400451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400420 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-token\" (UniqueName: \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-token\") pod \"5bef561c-0f3e-4b13-ac09-d70853b38226\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " Nov 04 02:23:43.400523 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400450 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-kube-api-access-m8tjx\" (UniqueName: \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-kube-api-access-m8tjx\") pod \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " Nov 04 02:23:43.400523 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400485 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-kube-api-access-mknbm\" (UniqueName: \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-kube-api-access-mknbm\") pod \"5bef561c-0f3e-4b13-ac09-d70853b38226\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " Nov 04 02:23:43.400523 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400480 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-socket" pod "e1f17096-e509-4a39-a6ca-7c6b39c8abde" (UID: "e1f17096-e509-4a39-a6ca-7c6b39c8abde"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:43.400523 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400518 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-credential-socket\") pod \"5bef561c-0f3e-4b13-ac09-d70853b38226\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " Nov 04 02:23:43.400706 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400516 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-socket" pod "5bef561c-0f3e-4b13-ac09-d70853b38226" (UID: "5bef561c-0f3e-4b13-ac09-d70853b38226"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:43.400706 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400545 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bef561c-0f3e-4b13-ac09-d70853b38226-istiod-ca-cert" pod "5bef561c-0f3e-4b13-ac09-d70853b38226" (UID: "5bef561c-0f3e-4b13-ac09-d70853b38226"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:23:43.400706 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400553 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-data" pod "5bef561c-0f3e-4b13-ac09-d70853b38226" (UID: "5bef561c-0f3e-4b13-ac09-d70853b38226"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:43.400706 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400645 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-podinfo\") pod \"5bef561c-0f3e-4b13-ac09-d70853b38226\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " Nov 04 02:23:43.400706 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400655 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-certs" pod "e1f17096-e509-4a39-a6ca-7c6b39c8abde" (UID: "e1f17096-e509-4a39-a6ca-7c6b39c8abde"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:43.400706 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400705 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-credential-socket\") pod \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " Nov 04 02:23:43.401000 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400732 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-certs\") pod \"5bef561c-0f3e-4b13-ac09-d70853b38226\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " Nov 04 02:23:43.401000 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400793 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-token\" (UniqueName: \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-token\") pod \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " Nov 04 02:23:43.401000 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400840 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-envoy\") pod \"5bef561c-0f3e-4b13-ac09-d70853b38226\" (UID: \"5bef561c-0f3e-4b13-ac09-d70853b38226\") " Nov 04 02:23:43.401000 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400878 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-data\") pod \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " Nov 04 02:23:43.401000 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400910 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-envoy\") pod \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " Nov 04 02:23:43.401000 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400935 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istiod-ca-cert\") pod \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " Nov 04 02:23:43.401000 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400980 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-podinfo\") pod \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\" (UID: \"e1f17096-e509-4a39-a6ca-7c6b39c8abde\") " Nov 04 02:23:43.401529 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.401457 5219 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bef561c-0f3e-4b13-ac09-d70853b38226-istiod-ca-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.401529 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.401477 5219 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-data\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.401529 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.401494 5219 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.401529 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.401508 5219 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.401529 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.401523 5219 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-workload-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.402158 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400732 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-credential-socket" pod "5bef561c-0f3e-4b13-ac09-d70853b38226" (UID: "5bef561c-0f3e-4b13-ac09-d70853b38226"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:43.402158 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400900 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-certs" pod "5bef561c-0f3e-4b13-ac09-d70853b38226" (UID: "5bef561c-0f3e-4b13-ac09-d70853b38226"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:43.402158 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.400910 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-credential-socket" pod "e1f17096-e509-4a39-a6ca-7c6b39c8abde" (UID: "e1f17096-e509-4a39-a6ca-7c6b39c8abde"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:43.402502 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.402461 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-data" pod "e1f17096-e509-4a39-a6ca-7c6b39c8abde" (UID: "e1f17096-e509-4a39-a6ca-7c6b39c8abde"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:43.402628 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.402603 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istiod-ca-cert" pod "e1f17096-e509-4a39-a6ca-7c6b39c8abde" (UID: "e1f17096-e509-4a39-a6ca-7c6b39c8abde"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:23:43.403149 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.403123 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-token" pod "5bef561c-0f3e-4b13-ac09-d70853b38226" (UID: "5bef561c-0f3e-4b13-ac09-d70853b38226"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:23:43.403847 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.403803 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-podinfo" pod "5bef561c-0f3e-4b13-ac09-d70853b38226" (UID: "5bef561c-0f3e-4b13-ac09-d70853b38226"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:23:43.403847 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.403824 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-kube-api-access-mknbm" pod "5bef561c-0f3e-4b13-ac09-d70853b38226" (UID: "5bef561c-0f3e-4b13-ac09-d70853b38226"). InnerVolumeSpecName "kube-api-access-mknbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:23:43.403975 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.403873 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-envoy" pod "5bef561c-0f3e-4b13-ac09-d70853b38226" (UID: "5bef561c-0f3e-4b13-ac09-d70853b38226"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:43.403975 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.403897 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-kube-api-access-m8tjx" pod "e1f17096-e509-4a39-a6ca-7c6b39c8abde" (UID: "e1f17096-e509-4a39-a6ca-7c6b39c8abde"). InnerVolumeSpecName "kube-api-access-m8tjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:23:43.404041 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.403980 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-token" pod "e1f17096-e509-4a39-a6ca-7c6b39c8abde" (UID: "e1f17096-e509-4a39-a6ca-7c6b39c8abde"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:23:43.404041 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.403994 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-podinfo" pod "e1f17096-e509-4a39-a6ca-7c6b39c8abde" (UID: "e1f17096-e509-4a39-a6ca-7c6b39c8abde"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:23:43.404279 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.404260 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-envoy" pod "e1f17096-e509-4a39-a6ca-7c6b39c8abde" (UID: "e1f17096-e509-4a39-a6ca-7c6b39c8abde"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:43.502827 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502807 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502827 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502827 5219 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-envoy\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502836 5219 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-data\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502849 5219 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-envoy\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502858 5219 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istiod-ca-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502866 5219 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f17096-e509-4a39-a6ca-7c6b39c8abde-istio-podinfo\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502873 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502881 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8tjx\" (UniqueName: \"kubernetes.io/projected/e1f17096-e509-4a39-a6ca-7c6b39c8abde-kube-api-access-m8tjx\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502890 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mknbm\" (UniqueName: \"kubernetes.io/projected/5bef561c-0f3e-4b13-ac09-d70853b38226-kube-api-access-mknbm\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502898 5219 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-credential-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502906 5219 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bef561c-0f3e-4b13-ac09-d70853b38226-istio-podinfo\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502914 5219 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f17096-e509-4a39-a6ca-7c6b39c8abde-credential-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.502947 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.502927 5219 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bef561c-0f3e-4b13-ac09-d70853b38226-workload-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:43.720482 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.720448 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" podUID="d6994b72-f668-44d8-ae8a-9d27011cea95" containerName="main" containerID="cri-o://101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91" gracePeriod=45 Nov 04 02:23:43.950206 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:43.950184 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:23:44.007510 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.007457 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-model-cache\") pod \"d6994b72-f668-44d8-ae8a-9d27011cea95\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " Nov 04 02:23:44.007510 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.007485 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-dshm\") pod \"d6994b72-f668-44d8-ae8a-9d27011cea95\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " Nov 04 02:23:44.007659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.007516 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-tmp-dir\") pod \"d6994b72-f668-44d8-ae8a-9d27011cea95\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " Nov 04 02:23:44.007659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.007563 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d6994b72-f668-44d8-ae8a-9d27011cea95-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6994b72-f668-44d8-ae8a-9d27011cea95-tls-certs\") pod \"d6994b72-f668-44d8-ae8a-9d27011cea95\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " Nov 04 02:23:44.007659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.007610 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6994b72-f668-44d8-ae8a-9d27011cea95-kube-api-access-zlf45\" (UniqueName: \"kubernetes.io/projected/d6994b72-f668-44d8-ae8a-9d27011cea95-kube-api-access-zlf45\") pod \"d6994b72-f668-44d8-ae8a-9d27011cea95\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " Nov 04 02:23:44.007802 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.007693 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-model-cache" pod "d6994b72-f668-44d8-ae8a-9d27011cea95" (UID: "d6994b72-f668-44d8-ae8a-9d27011cea95"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:44.007802 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.007737 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-home\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-home\") pod \"d6994b72-f668-44d8-ae8a-9d27011cea95\" (UID: \"d6994b72-f668-44d8-ae8a-9d27011cea95\") " Nov 04 02:23:44.007908 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.007814 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-tmp-dir" pod "d6994b72-f668-44d8-ae8a-9d27011cea95" (UID: "d6994b72-f668-44d8-ae8a-9d27011cea95"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:44.007988 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.007969 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-home" pod "d6994b72-f668-44d8-ae8a-9d27011cea95" (UID: "d6994b72-f668-44d8-ae8a-9d27011cea95"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:44.008075 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.008045 5219 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-model-cache\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:44.008075 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.008066 5219 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-tmp-dir\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:44.008256 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.008080 5219 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-home\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:44.009786 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.009766 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6994b72-f668-44d8-ae8a-9d27011cea95-tls-certs" pod "d6994b72-f668-44d8-ae8a-9d27011cea95" (UID: "d6994b72-f668-44d8-ae8a-9d27011cea95"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 02:23:44.010139 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.010123 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6994b72-f668-44d8-ae8a-9d27011cea95-kube-api-access-zlf45" pod "d6994b72-f668-44d8-ae8a-9d27011cea95" (UID: "d6994b72-f668-44d8-ae8a-9d27011cea95"). InnerVolumeSpecName "kube-api-access-zlf45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:23:44.010139 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.010126 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-dshm" pod "d6994b72-f668-44d8-ae8a-9d27011cea95" (UID: "d6994b72-f668-44d8-ae8a-9d27011cea95"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:23:44.108540 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.108515 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlf45\" (UniqueName: \"kubernetes.io/projected/d6994b72-f668-44d8-ae8a-9d27011cea95-kube-api-access-zlf45\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:44.108540 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.108540 5219 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6994b72-f668-44d8-ae8a-9d27011cea95-dshm\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:44.108758 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.108548 5219 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6994b72-f668-44d8-ae8a-9d27011cea95-tls-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:23:44.110724 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.110700 5219 generic.go:356] "Generic (PLEG): container finished" podID="d6994b72-f668-44d8-ae8a-9d27011cea95" containerID="101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91" exitCode=0 Nov 04 02:23:44.110831 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.110743 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" event={"ID":"d6994b72-f668-44d8-ae8a-9d27011cea95","Type":"ContainerDied","Data":"101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91"} Nov 04 02:23:44.110831 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.110768 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" Nov 04 02:23:44.110831 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.110787 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb" event={"ID":"d6994b72-f668-44d8-ae8a-9d27011cea95","Type":"ContainerDied","Data":"0900ef7902390d33711a1ee5389787157e7cb42970bda342940fb0fc1bf38487"} Nov 04 02:23:44.110831 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.110804 5219 scope.go:122] "RemoveContainer" containerID="101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91" Nov 04 02:23:44.112369 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.112348 5219 generic.go:356] "Generic (PLEG): container finished" podID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerID="5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa" exitCode=0 Nov 04 02:23:44.112474 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.112376 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" event={"ID":"e1f17096-e509-4a39-a6ca-7c6b39c8abde","Type":"ContainerDied","Data":"5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa"} Nov 04 02:23:44.112474 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.112408 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" Nov 04 02:23:44.112474 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.112421 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx" event={"ID":"e1f17096-e509-4a39-a6ca-7c6b39c8abde","Type":"ContainerDied","Data":"5340f6353c94848e92ccfacb7d98a5b6042162ea9e92e953df605f4e75c77e94"} Nov 04 02:23:44.114223 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.114200 5219 generic.go:356] "Generic (PLEG): container finished" podID="5bef561c-0f3e-4b13-ac09-d70853b38226" containerID="791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe" exitCode=0 Nov 04 02:23:44.114341 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.114239 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" event={"ID":"5bef561c-0f3e-4b13-ac09-d70853b38226","Type":"ContainerDied","Data":"791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe"} Nov 04 02:23:44.114341 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.114274 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" event={"ID":"5bef561c-0f3e-4b13-ac09-d70853b38226","Type":"ContainerDied","Data":"c6547c8a48b13dae764d852520188cf3914cfee831dfbe7fae518bff7b61f4d4"} Nov 04 02:23:44.114341 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.114326 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69" Nov 04 02:23:44.120019 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.119723 5219 scope.go:122] "RemoveContainer" containerID="101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91" Nov 04 02:23:44.120110 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:23:44.120047 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91\": container with ID starting with 101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91 not found: ID does not exist" containerID="101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91" Nov 04 02:23:44.120110 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.120078 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91"} err="failed to get container status \"101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91\": rpc error: code = NotFound desc = could not find container \"101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91\": container with ID starting with 101e112fd60d2e18eeaac0002bda0e649a226c69292292a1020c72ad0ecc2f91 not found: ID does not exist" Nov 04 02:23:44.120110 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.120101 5219 scope.go:122] "RemoveContainer" containerID="5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa" Nov 04 02:23:44.129010 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.128994 5219 scope.go:122] "RemoveContainer" containerID="5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa" Nov 04 02:23:44.129263 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:23:44.129246 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa\": container with ID starting with 5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa not found: ID does not exist" containerID="5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa" Nov 04 02:23:44.129435 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.129268 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa"} err="failed to get container status \"5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa\": rpc error: code = NotFound desc = could not find container \"5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa\": container with ID starting with 5327b9dfe89a3a8e530e586faff8078919ea57ca5e582cf73d51d7b489e16aaa not found: ID does not exist" Nov 04 02:23:44.129435 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.129330 5219 scope.go:122] "RemoveContainer" containerID="791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe" Nov 04 02:23:44.136894 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.136879 5219 scope.go:122] "RemoveContainer" containerID="791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe" Nov 04 02:23:44.137179 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:23:44.137155 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe\": container with ID starting with 791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe not found: ID does not exist" containerID="791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe" Nov 04 02:23:44.137267 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.137188 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe"} err="failed to get container status \"791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe\": rpc error: code = NotFound desc = could not find container \"791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe\": container with ID starting with 791dc8f6802a08f3ceb80940fe20f5115cdda35f50cbcafcbc6cd7030f116ffe not found: ID does not exist" Nov 04 02:23:44.273222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.273025 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb"] Nov 04 02:23:44.275007 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.274989 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-dd5d18/simulator-w5-dd5d18-kserve-5d57888c88-k6zfb"] Nov 04 02:23:44.383782 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.383755 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx"] Nov 04 02:23:44.388828 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.388805 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-hmwxx"] Nov 04 02:23:44.495660 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.495626 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69"] Nov 04 02:23:44.500164 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.500140 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-e34b54-openshift-default-854f9f566c-mhg69"] Nov 04 02:23:44.615246 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.615184 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5bef561c-0f3e-4b13-ac09-d70853b38226" path="/var/lib/kubelet/pods/5bef561c-0f3e-4b13-ac09-d70853b38226/volumes" Nov 04 02:23:44.615560 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.615547 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6994b72-f668-44d8-ae8a-9d27011cea95" path="/var/lib/kubelet/pods/d6994b72-f668-44d8-ae8a-9d27011cea95/volumes" Nov 04 02:23:44.615892 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:23:44.615881 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" path="/var/lib/kubelet/pods/e1f17096-e509-4a39-a6ca-7c6b39c8abde/volumes" Nov 04 02:24:08.669367 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669337 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5"] Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669624 5219 cpu_manager.go:414] "containerMap: removing container" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669634 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669647 5219 cpu_manager.go:414] "containerMap: removing container" podUID="a68b0ce8-4f44-4abd-b9f9-869c1632aa5f" containerName="revoke-keys" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669651 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a68b0ce8-4f44-4abd-b9f9-869c1632aa5f" containerName="revoke-keys" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669658 5219 cpu_manager.go:414] "containerMap: removing container" podUID="2db863a6-cf81-4135-8941-277b1e5974ca" containerName="main" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669663 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2db863a6-cf81-4135-8941-277b1e5974ca" containerName="main" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669670 5219 cpu_manager.go:414] "containerMap: removing container" podUID="d6994b72-f668-44d8-ae8a-9d27011cea95" containerName="main" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669674 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6994b72-f668-44d8-ae8a-9d27011cea95" containerName="main" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669687 5219 cpu_manager.go:414] "containerMap: removing container" podUID="5bef561c-0f3e-4b13-ac09-d70853b38226" containerName="istio-proxy" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669692 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5bef561c-0f3e-4b13-ac09-d70853b38226" containerName="istio-proxy" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669703 5219 cpu_manager.go:414] "containerMap: removing container" podUID="5cadf750-853e-48ef-8e72-fd6665a740dd" containerName="main" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669708 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5cadf750-853e-48ef-8e72-fd6665a740dd" containerName="main" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669754 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="a68b0ce8-4f44-4abd-b9f9-869c1632aa5f" containerName="revoke-keys" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669760 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="2db863a6-cf81-4135-8941-277b1e5974ca" containerName="main" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669766 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6994b72-f668-44d8-ae8a-9d27011cea95" containerName="main" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669772 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="5bef561c-0f3e-4b13-ac09-d70853b38226" containerName="istio-proxy" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669779 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="5cadf750-853e-48ef-8e72-fd6665a740dd" containerName="main" Nov 04 02:24:08.669819 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.669785 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="e1f17096-e509-4a39-a6ca-7c6b39c8abde" containerName="istio-proxy" Nov 04 02:24:08.672667 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.672653 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.719364 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.719333 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5"] Nov 04 02:24:08.722685 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.722667 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.768814 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.768784 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5"] Nov 04 02:24:08.812328 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812273 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-credential-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.812328 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812329 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-podinfo\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.812536 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812402 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-certs\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.812536 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812447 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-envoy\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.812536 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812514 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.812656 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812542 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwlg2\" (UniqueName: \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-kube-api-access-zwlg2\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.812656 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812560 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istiod-ca-cert\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.812656 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812597 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4d2p\" (UniqueName: \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-kube-api-access-r4d2p\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.813101 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812672 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-data\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.813101 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812697 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-token\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.813101 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812718 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.813101 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812734 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istiod-ca-cert\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.813101 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812819 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-credential-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.813101 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812929 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-data\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.813101 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.812976 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-certs\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.813101 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.813019 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-token\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.813101 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.813040 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-envoy\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.813101 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.813064 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-podinfo\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.827152 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.827127 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5"] Nov 04 02:24:08.914336 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914299 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-credential-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.914479 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914362 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-data\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.914479 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914389 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-certs\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.914479 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914417 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-token\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.914479 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914447 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-envoy\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.914479 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914475 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-podinfo\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.914718 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914527 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-credential-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.914718 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914558 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-podinfo\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.914718 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914592 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-certs\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.914718 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914633 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-credential-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.914718 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914649 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-envoy\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.914718 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914681 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-certs\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.914718 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914713 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.915077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914750 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlg2\" (UniqueName: \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-kube-api-access-zwlg2\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.915077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914779 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istiod-ca-cert\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.915077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914801 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4d2p\" (UniqueName: \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-kube-api-access-r4d2p\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.915077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914831 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-data\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.915077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914864 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-token\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.915077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914900 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.915077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914924 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istiod-ca-cert\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.915077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914946 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-data\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.915077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.914970 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-certs\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.915723 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.915231 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.915723 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.915234 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.915723 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.915478 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-credential-socket\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.915723 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.915670 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-data\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.916043 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.916023 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istiod-ca-cert\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.916104 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.916048 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istiod-ca-cert\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.917129 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.917101 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-podinfo\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.917342 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.917324 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-podinfo\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.917474 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.917453 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-envoy\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.917987 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.917967 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-envoy\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.931129 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:24:08.931105 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:24:08.974792 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.974772 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-token\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.975142 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.975125 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-token\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.975248 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.975231 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwlg2\" (UniqueName: \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-kube-api-access-zwlg2\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:08.975627 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.975606 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4d2p\" (UniqueName: \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-kube-api-access-r4d2p\") pod \"e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:08.984253 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:08.984236 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:09.035222 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:09.035189 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:09.419176 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:09.419148 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5"] Nov 04 02:24:09.421122 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:24:09.421091 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4481cf2c_62ec_4bbd_b40b_264a3f50382b.slice/crio-0bb2a86ca5fe272da8101bb109a234ec9d9ee03534cdd51345fcf428771bf2e0 WatchSource:0}: Error finding container 0bb2a86ca5fe272da8101bb109a234ec9d9ee03534cdd51345fcf428771bf2e0: Status 404 returned error can't find the container with id 0bb2a86ca5fe272da8101bb109a234ec9d9ee03534cdd51345fcf428771bf2e0 Nov 04 02:24:09.423154 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:09.423114 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:24:09.423216 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:09.423197 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:24:09.423255 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:09.423243 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:24:09.520741 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:09.520707 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5"] Nov 04 02:24:09.524448 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:24:09.524410 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b7973f_9e9f_49a3_b7eb_d5e5f03a50f0.slice/crio-8b6ef45c54106207628121941325d08dcc427db28e4c892e8f9643b6e75e87b2 WatchSource:0}: Error finding container 8b6ef45c54106207628121941325d08dcc427db28e4c892e8f9643b6e75e87b2: Status 404 returned error can't find the container with id 8b6ef45c54106207628121941325d08dcc427db28e4c892e8f9643b6e75e87b2 Nov 04 02:24:09.530991 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:09.530950 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:24:09.531089 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:09.531031 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:24:09.531089 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:09.531075 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:24:10.264923 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:10.264886 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" event={"ID":"4481cf2c-62ec-4bbd-b40b-264a3f50382b","Type":"ContainerStarted","Data":"ab7e3bc07607f85ae1173a3e6ec7c620e971ee74cf83e30be26bc62af7a38fcb"} Nov 04 02:24:10.265522 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:10.265483 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" event={"ID":"4481cf2c-62ec-4bbd-b40b-264a3f50382b","Type":"ContainerStarted","Data":"0bb2a86ca5fe272da8101bb109a234ec9d9ee03534cdd51345fcf428771bf2e0"} Nov 04 02:24:10.269260 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:10.269233 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" event={"ID":"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0","Type":"ContainerStarted","Data":"76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3"} Nov 04 02:24:10.269487 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:10.269457 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" event={"ID":"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0","Type":"ContainerStarted","Data":"8b6ef45c54106207628121941325d08dcc427db28e4c892e8f9643b6e75e87b2"} Nov 04 02:24:10.395445 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:10.395386 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" podStartSLOduration=2.395368992 podStartE2EDuration="2.395368992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:24:10.393676318 +0000 UTC m=+995.882185020" watchObservedRunningTime="2026-11-04 02:24:10.395368992 +0000 UTC m=+995.883877692" Nov 04 02:24:10.515161 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:10.515064 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" podStartSLOduration=2.515050914 podStartE2EDuration="2.515050914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:24:10.513502939 +0000 UTC m=+996.002011674" watchObservedRunningTime="2026-11-04 02:24:10.515050914 +0000 UTC m=+996.003559614" Nov 04 02:24:10.988626 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:10.986634 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:10.996618 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:10.996582 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 02:24:10.996742 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:10.996639 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 02:24:11.041578 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:11.035637 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:11.043549 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:11.043414 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 02:24:11.043549 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:11.043472 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" podUID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 02:24:11.985760 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:11.985719 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 02:24:11.986367 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:11.986332 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 02:24:12.006697 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.006671 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4"] Nov 04 02:24:12.011754 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.011732 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.035768 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.035720 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 02:24:12.036031 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.035996 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" podUID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 02:24:12.109921 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.109886 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4"] Nov 04 02:24:12.168571 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.168531 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-9adedd-openshift-default-dockercfg-4x2k2\"" Nov 04 02:24:12.199768 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.199725 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/877276eb-458b-40c3-85a6-be78d6c11af2-istio-podinfo\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.207316 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.200019 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-envoy\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.207523 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.207499 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggw65\" (UniqueName: \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-kube-api-access-ggw65\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.207670 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.207654 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-istio-token\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.207800 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.207785 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-socket\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.207942 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.207927 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/877276eb-458b-40c3-85a6-be78d6c11af2-istiod-ca-cert\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.208408 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.208388 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-certs\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.208586 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.208569 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-data\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.209046 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.208715 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-credential-socket\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.310455 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.310389 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/877276eb-458b-40c3-85a6-be78d6c11af2-istiod-ca-cert\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.310455 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.310423 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-certs\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.310455 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.310446 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-data\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.310659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.310473 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-credential-socket\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.310659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.310532 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/877276eb-458b-40c3-85a6-be78d6c11af2-istio-podinfo\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.310659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.310559 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-envoy\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.310659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.310590 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggw65\" (UniqueName: \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-kube-api-access-ggw65\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.310659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.310611 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-istio-token\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.310659 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.310645 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-socket\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.311123 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.310949 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/877276eb-458b-40c3-85a6-be78d6c11af2-istiod-ca-cert\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.311505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.311226 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-data\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.311505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.311238 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-socket\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.311505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.311427 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-credential-socket\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.311505 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.311500 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-certs\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.313811 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.313744 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-envoy\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.314109 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.314093 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/877276eb-458b-40c3-85a6-be78d6c11af2-istio-podinfo\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.372233 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.372195 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-istio-token\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.372663 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.372641 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggw65\" (UniqueName: \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-kube-api-access-ggw65\") pod \"e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.659777 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.659452 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:12.985198 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.985161 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 02:24:12.985387 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:12.985217 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 02:24:13.037311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.036659 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 02:24:13.037311 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.036722 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" podUID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 02:24:13.145815 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.144627 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4"] Nov 04 02:24:13.149973 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.147380 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:24:13.149973 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.147462 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:24:13.149973 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.147508 5219 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892000Ki","pods":"250"} Nov 04 02:24:13.290664 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.290592 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" event={"ID":"877276eb-458b-40c3-85a6-be78d6c11af2","Type":"ContainerStarted","Data":"5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca"} Nov 04 02:24:13.290664 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.290640 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" event={"ID":"877276eb-458b-40c3-85a6-be78d6c11af2","Type":"ContainerStarted","Data":"07fca6ac3f36b59f9e091ba145ee9db1f8d6420b13014e90531192b654fa055c"} Nov 04 02:24:13.661363 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.660580 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:13.988310 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.986701 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 02:24:13.988310 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:13.986759 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 02:24:14.039314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:14.035780 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 02:24:14.039314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:14.035841 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" podUID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 02:24:14.668313 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:14.668124 5219 patch_prober.go:29] interesting pod/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 02:24:14.668313 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:14.668182 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" podUID="877276eb-458b-40c3-85a6-be78d6c11af2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 02:24:14.986314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:14.984950 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 02:24:14.986314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:14.985025 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 02:24:15.038312 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.037565 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 02:24:15.038312 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.037621 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" podUID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 02:24:15.661096 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.661051 5219 patch_prober.go:29] interesting pod/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 02:24:15.661670 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.661122 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" podUID="877276eb-458b-40c3-85a6-be78d6c11af2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 02:24:15.984880 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.984840 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 02:24:15.985066 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.984919 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 02:24:15.995231 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.995179 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" podStartSLOduration=4.995161085 podStartE2EDuration="4.995161085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:24:13.426218752 +0000 UTC m=+998.914727453" watchObservedRunningTime="2026-11-04 02:24:15.995161085 +0000 UTC m=+1001.483669786" Nov 04 02:24:15.996765 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.996744 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5"] Nov 04 02:24:15.997009 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.996988 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerName="istio-proxy" containerID="cri-o://ab7e3bc07607f85ae1173a3e6ec7c620e971ee74cf83e30be26bc62af7a38fcb" gracePeriod=30 Nov 04 02:24:15.998335 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.998310 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5"] Nov 04 02:24:15.998511 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:15.998493 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" podUID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" containerName="istio-proxy" containerID="cri-o://76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3" gracePeriod=30 Nov 04 02:24:16.047650 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:16.047619 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg"] Nov 04 02:24:16.048631 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:16.048606 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" containerID="cri-o://28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20" gracePeriod=30 Nov 04 02:24:16.140472 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:16.140438 5219 patch_prober.go:29] interesting pod/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 02:24:16.140762 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:16.140737 5219 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 02:24:16.661434 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:16.661398 5219 patch_prober.go:29] interesting pod/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 02:24:16.661851 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:16.661464 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" podUID="877276eb-458b-40c3-85a6-be78d6c11af2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 02:24:17.660721 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:17.660680 5219 patch_prober.go:29] interesting pod/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 02:24:17.660894 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:17.660738 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" podUID="877276eb-458b-40c3-85a6-be78d6c11af2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 02:24:18.660425 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:18.660391 5219 patch_prober.go:29] interesting pod/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 02:24:18.660817 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:18.660446 5219 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" podUID="877276eb-458b-40c3-85a6-be78d6c11af2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 02:24:19.607280 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:19.607249 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:24:19.815985 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:19.815949 5219 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:19.816609 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:19.816589 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:19.817178 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:19.817151 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:21.304473 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.304441 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:24:21.354692 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.354627 5219 generic.go:356] "Generic (PLEG): container finished" podID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerID="28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20" exitCode=0 Nov 04 02:24:21.354692 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.354676 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" Nov 04 02:24:21.354908 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.354714 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" event={"ID":"408600b3-be86-4e51-9c54-cd40eb3ef49e","Type":"ContainerDied","Data":"28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20"} Nov 04 02:24:21.354908 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.354803 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg" event={"ID":"408600b3-be86-4e51-9c54-cd40eb3ef49e","Type":"ContainerDied","Data":"7e017a360e21b06aedb592164468072b7c2b89217124bcca1795a9b541c46530"} Nov 04 02:24:21.354908 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.354832 5219 scope.go:122] "RemoveContainer" containerID="28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20" Nov 04 02:24:21.363525 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.363509 5219 scope.go:122] "RemoveContainer" containerID="28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20" Nov 04 02:24:21.363779 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:24:21.363759 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20\": container with ID starting with 28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20 not found: ID does not exist" containerID="28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20" Nov 04 02:24:21.363843 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.363791 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20"} err="failed to get container status \"28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20\": rpc error: code = NotFound desc = could not find container \"28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20\": container with ID starting with 28618fa8179b787a2b4c2c19d314cdf4e62f618ec3a679c436be3c12b808dc20 not found: ID does not exist" Nov 04 02:24:21.375174 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375155 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-kube-api-access-4rr62\" (UniqueName: \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-kube-api-access-4rr62\") pod \"408600b3-be86-4e51-9c54-cd40eb3ef49e\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " Nov 04 02:24:21.375262 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375237 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-podinfo\") pod \"408600b3-be86-4e51-9c54-cd40eb3ef49e\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " Nov 04 02:24:21.375343 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375269 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-token\" (UniqueName: \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-token\") pod \"408600b3-be86-4e51-9c54-cd40eb3ef49e\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " Nov 04 02:24:21.375343 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375326 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-data\") pod \"408600b3-be86-4e51-9c54-cd40eb3ef49e\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " Nov 04 02:24:21.375447 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375371 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-socket\") pod \"408600b3-be86-4e51-9c54-cd40eb3ef49e\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " Nov 04 02:24:21.375447 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375411 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/408600b3-be86-4e51-9c54-cd40eb3ef49e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408600b3-be86-4e51-9c54-cd40eb3ef49e-istiod-ca-cert\") pod \"408600b3-be86-4e51-9c54-cd40eb3ef49e\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " Nov 04 02:24:21.375538 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375450 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-certs\") pod \"408600b3-be86-4e51-9c54-cd40eb3ef49e\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " Nov 04 02:24:21.375538 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375494 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-credential-socket\") pod \"408600b3-be86-4e51-9c54-cd40eb3ef49e\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " Nov 04 02:24:21.375538 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375523 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-envoy\") pod \"408600b3-be86-4e51-9c54-cd40eb3ef49e\" (UID: \"408600b3-be86-4e51-9c54-cd40eb3ef49e\") " Nov 04 02:24:21.375683 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375621 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-data" pod "408600b3-be86-4e51-9c54-cd40eb3ef49e" (UID: "408600b3-be86-4e51-9c54-cd40eb3ef49e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:21.375683 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375663 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-socket" pod "408600b3-be86-4e51-9c54-cd40eb3ef49e" (UID: "408600b3-be86-4e51-9c54-cd40eb3ef49e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:21.375683 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375667 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-certs" pod "408600b3-be86-4e51-9c54-cd40eb3ef49e" (UID: "408600b3-be86-4e51-9c54-cd40eb3ef49e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:21.375841 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.375825 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-credential-socket" pod "408600b3-be86-4e51-9c54-cd40eb3ef49e" (UID: "408600b3-be86-4e51-9c54-cd40eb3ef49e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:21.376650 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.376021 5219 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-data\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:21.376650 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.376065 5219 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:21.376650 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.376095 5219 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-workload-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:21.376650 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.376116 5219 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-credential-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:21.376650 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.376200 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/408600b3-be86-4e51-9c54-cd40eb3ef49e-istiod-ca-cert" pod "408600b3-be86-4e51-9c54-cd40eb3ef49e" (UID: "408600b3-be86-4e51-9c54-cd40eb3ef49e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:24:21.377489 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.377459 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-podinfo" pod "408600b3-be86-4e51-9c54-cd40eb3ef49e" (UID: "408600b3-be86-4e51-9c54-cd40eb3ef49e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:24:21.377890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.377870 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-envoy" pod "408600b3-be86-4e51-9c54-cd40eb3ef49e" (UID: "408600b3-be86-4e51-9c54-cd40eb3ef49e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:21.377941 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.377913 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-token" pod "408600b3-be86-4e51-9c54-cd40eb3ef49e" (UID: "408600b3-be86-4e51-9c54-cd40eb3ef49e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:24:21.377941 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.377927 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-kube-api-access-4rr62" pod "408600b3-be86-4e51-9c54-cd40eb3ef49e" (UID: "408600b3-be86-4e51-9c54-cd40eb3ef49e"). InnerVolumeSpecName "kube-api-access-4rr62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:24:21.477262 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.477229 5219 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408600b3-be86-4e51-9c54-cd40eb3ef49e-istiod-ca-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:21.477262 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.477257 5219 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-envoy\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:21.477262 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.477268 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rr62\" (UniqueName: \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-kube-api-access-4rr62\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:21.477576 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.477278 5219 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-podinfo\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:21.477576 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.477313 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408600b3-be86-4e51-9c54-cd40eb3ef49e-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:21.773075 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.773044 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg"] Nov 04 02:24:21.775132 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:21.775111 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-vp2bg"] Nov 04 02:24:22.360894 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.360871 5219 generic.go:356] "Generic (PLEG): container finished" podID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerID="ab7e3bc07607f85ae1173a3e6ec7c620e971ee74cf83e30be26bc62af7a38fcb" exitCode=0 Nov 04 02:24:22.361268 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.360946 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" event={"ID":"4481cf2c-62ec-4bbd-b40b-264a3f50382b","Type":"ContainerDied","Data":"ab7e3bc07607f85ae1173a3e6ec7c620e971ee74cf83e30be26bc62af7a38fcb"} Nov 04 02:24:22.361268 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.360997 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" event={"ID":"4481cf2c-62ec-4bbd-b40b-264a3f50382b","Type":"ContainerDied","Data":"0bb2a86ca5fe272da8101bb109a234ec9d9ee03534cdd51345fcf428771bf2e0"} Nov 04 02:24:22.361268 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.361015 5219 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bb2a86ca5fe272da8101bb109a234ec9d9ee03534cdd51345fcf428771bf2e0" Nov 04 02:24:22.415862 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.415813 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:22.485713 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.485686 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-kube-api-access-zwlg2\" (UniqueName: \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-kube-api-access-zwlg2\") pod \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " Nov 04 02:24:22.485841 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.485734 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-envoy\") pod \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " Nov 04 02:24:22.485841 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.485806 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-credential-socket\") pod \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " Nov 04 02:24:22.485963 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.485859 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-podinfo\") pod \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " Nov 04 02:24:22.485963 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.485889 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-token\" (UniqueName: \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-token\") pod \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " Nov 04 02:24:22.485963 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.485932 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-socket\") pod \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " Nov 04 02:24:22.486126 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.485966 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-certs\") pod \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " Nov 04 02:24:22.486126 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.486007 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istiod-ca-cert\") pod \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " Nov 04 02:24:22.486126 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.486055 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-data\") pod \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\" (UID: \"4481cf2c-62ec-4bbd-b40b-264a3f50382b\") " Nov 04 02:24:22.487140 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.486540 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-data" pod "4481cf2c-62ec-4bbd-b40b-264a3f50382b" (UID: "4481cf2c-62ec-4bbd-b40b-264a3f50382b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:22.487140 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.486976 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-certs" pod "4481cf2c-62ec-4bbd-b40b-264a3f50382b" (UID: "4481cf2c-62ec-4bbd-b40b-264a3f50382b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:22.487140 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.487024 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-socket" pod "4481cf2c-62ec-4bbd-b40b-264a3f50382b" (UID: "4481cf2c-62ec-4bbd-b40b-264a3f50382b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:22.487469 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.487068 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-credential-socket" pod "4481cf2c-62ec-4bbd-b40b-264a3f50382b" (UID: "4481cf2c-62ec-4bbd-b40b-264a3f50382b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:22.487469 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.487133 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istiod-ca-cert" pod "4481cf2c-62ec-4bbd-b40b-264a3f50382b" (UID: "4481cf2c-62ec-4bbd-b40b-264a3f50382b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:24:22.488486 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.488439 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-kube-api-access-zwlg2" pod "4481cf2c-62ec-4bbd-b40b-264a3f50382b" (UID: "4481cf2c-62ec-4bbd-b40b-264a3f50382b"). InnerVolumeSpecName "kube-api-access-zwlg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:24:22.489133 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.489098 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-envoy" pod "4481cf2c-62ec-4bbd-b40b-264a3f50382b" (UID: "4481cf2c-62ec-4bbd-b40b-264a3f50382b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:22.489615 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.489593 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-podinfo" pod "4481cf2c-62ec-4bbd-b40b-264a3f50382b" (UID: "4481cf2c-62ec-4bbd-b40b-264a3f50382b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:24:22.489911 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.489883 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-token" pod "4481cf2c-62ec-4bbd-b40b-264a3f50382b" (UID: "4481cf2c-62ec-4bbd-b40b-264a3f50382b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:24:22.533314 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.533275 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:22.587463 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587442 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-kube-api-access-r4d2p\" (UniqueName: \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-kube-api-access-r4d2p\") pod \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " Nov 04 02:24:22.587565 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587478 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-credential-socket\") pod \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " Nov 04 02:24:22.587565 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587526 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-data\") pod \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " Nov 04 02:24:22.587565 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587559 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-envoy\") pod \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " Nov 04 02:24:22.587709 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587583 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-certs\") pod \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " Nov 04 02:24:22.587709 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587603 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-socket\") pod \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " Nov 04 02:24:22.587709 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587626 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istiod-ca-cert\") pod \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " Nov 04 02:24:22.587709 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587654 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-podinfo\") pod \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " Nov 04 02:24:22.587709 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587700 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-token\" (UniqueName: \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-token\") pod \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\" (UID: \"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0\") " Nov 04 02:24:22.587941 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587824 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-data" pod "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" (UID: "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:22.587941 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587854 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-credential-socket" pod "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" (UID: "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:22.587941 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.587881 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-certs" pod "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" (UID: "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:22.588089 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588048 5219 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-credential-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588089 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588067 5219 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-data\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588089 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588083 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwlg2\" (UniqueName: \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-kube-api-access-zwlg2\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588097 5219 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-envoy\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588112 5219 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-data\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588130 5219 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-credential-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588134 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istiod-ca-cert" pod "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" (UID: "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588146 5219 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588159 5219 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-podinfo\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588172 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588185 5219 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588197 5219 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4481cf2c-62ec-4bbd-b40b-264a3f50382b-workload-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588210 5219 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4481cf2c-62ec-4bbd-b40b-264a3f50382b-istiod-ca-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.588214 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.588195 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-socket" pod "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" (UID: "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:22.589890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.589873 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-token" pod "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" (UID: "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:24:22.589890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.589883 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-podinfo" pod "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" (UID: "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:24:22.590151 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.590132 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-envoy" pod "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" (UID: "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:22.590151 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.590143 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-kube-api-access-r4d2p" pod "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" (UID: "49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0"). InnerVolumeSpecName "kube-api-access-r4d2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:24:22.613055 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.613025 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" path="/var/lib/kubelet/pods/408600b3-be86-4e51-9c54-cd40eb3ef49e/volumes" Nov 04 02:24:22.688849 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.688820 5219 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-envoy\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.688939 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.688852 5219 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-workload-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.688939 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.688868 5219 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istiod-ca-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.688939 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.688881 5219 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-podinfo\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.688939 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.688894 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:22.688939 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:22.688907 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4d2p\" (UniqueName: \"kubernetes.io/projected/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0-kube-api-access-r4d2p\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:23.367764 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.367733 5219 generic.go:356] "Generic (PLEG): container finished" podID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" containerID="76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3" exitCode=0 Nov 04 02:24:23.368072 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.367790 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" Nov 04 02:24:23.368072 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.367821 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" event={"ID":"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0","Type":"ContainerDied","Data":"76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3"} Nov 04 02:24:23.368072 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.367877 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5" event={"ID":"49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0","Type":"ContainerDied","Data":"8b6ef45c54106207628121941325d08dcc427db28e4c892e8f9643b6e75e87b2"} Nov 04 02:24:23.368072 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.367900 5219 scope.go:122] "RemoveContainer" containerID="76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3" Nov 04 02:24:23.368275 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.368072 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5" Nov 04 02:24:23.376208 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.376194 5219 scope.go:122] "RemoveContainer" containerID="76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3" Nov 04 02:24:23.376497 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:24:23.376475 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3\": container with ID starting with 76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3 not found: ID does not exist" containerID="76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3" Nov 04 02:24:23.376589 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.376503 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3"} err="failed to get container status \"76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3\": rpc error: code = NotFound desc = could not find container \"76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3\": container with ID starting with 76161473d8b9949513da24e0c8ec7f964f0fc3c5c95f1fcf55dca757114afcf3 not found: ID does not exist" Nov 04 02:24:23.531501 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.531479 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5"] Nov 04 02:24:23.580686 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.580662 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-9zxs5"] Nov 04 02:24:23.690823 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.690803 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5"] Nov 04 02:24:23.693801 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:23.693783 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd5d18-openshift-default-c7c7d86c-4v2v5"] Nov 04 02:24:24.613765 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:24.613736 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" path="/var/lib/kubelet/pods/4481cf2c-62ec-4bbd-b40b-264a3f50382b/volumes" Nov 04 02:24:24.614111 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:24.614090 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" path="/var/lib/kubelet/pods/49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0/volumes" Nov 04 02:24:27.771331 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:27.771297 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4"] Nov 04 02:24:27.771745 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:27.771471 5219 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" podUID="877276eb-458b-40c3-85a6-be78d6c11af2" containerName="istio-proxy" containerID="cri-o://5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca" gracePeriod=30 Nov 04 02:24:33.016452 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.016429 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:33.067828 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.067772 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-data\") pod \"877276eb-458b-40c3-85a6-be78d6c11af2\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " Nov 04 02:24:33.067954 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.067824 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/877276eb-458b-40c3-85a6-be78d6c11af2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/877276eb-458b-40c3-85a6-be78d6c11af2-istio-podinfo\") pod \"877276eb-458b-40c3-85a6-be78d6c11af2\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " Nov 04 02:24:33.067954 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.067852 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-credential-socket\") pod \"877276eb-458b-40c3-85a6-be78d6c11af2\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " Nov 04 02:24:33.067954 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.067895 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/877276eb-458b-40c3-85a6-be78d6c11af2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/877276eb-458b-40c3-85a6-be78d6c11af2-istiod-ca-cert\") pod \"877276eb-458b-40c3-85a6-be78d6c11af2\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " Nov 04 02:24:33.067954 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.067923 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-envoy\") pod \"877276eb-458b-40c3-85a6-be78d6c11af2\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " Nov 04 02:24:33.068160 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.067966 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-kube-api-access-ggw65\" (UniqueName: \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-kube-api-access-ggw65\") pod \"877276eb-458b-40c3-85a6-be78d6c11af2\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " Nov 04 02:24:33.068160 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068000 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-socket\") pod \"877276eb-458b-40c3-85a6-be78d6c11af2\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " Nov 04 02:24:33.068160 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068041 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-certs\") pod \"877276eb-458b-40c3-85a6-be78d6c11af2\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " Nov 04 02:24:33.068160 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068119 5219 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-istio-token\" (UniqueName: \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-istio-token\") pod \"877276eb-458b-40c3-85a6-be78d6c11af2\" (UID: \"877276eb-458b-40c3-85a6-be78d6c11af2\") " Nov 04 02:24:33.068378 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068180 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-data" pod "877276eb-458b-40c3-85a6-be78d6c11af2" (UID: "877276eb-458b-40c3-85a6-be78d6c11af2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:33.068378 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068190 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-credential-socket" pod "877276eb-458b-40c3-85a6-be78d6c11af2" (UID: "877276eb-458b-40c3-85a6-be78d6c11af2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:33.068378 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068312 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/877276eb-458b-40c3-85a6-be78d6c11af2-istiod-ca-cert" pod "877276eb-458b-40c3-85a6-be78d6c11af2" (UID: "877276eb-458b-40c3-85a6-be78d6c11af2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:24:33.068525 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068411 5219 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-data\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:33.068525 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068424 5219 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-credential-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:33.068525 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068436 5219 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/877276eb-458b-40c3-85a6-be78d6c11af2-istiod-ca-cert\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:33.068640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068523 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-certs" pod "877276eb-458b-40c3-85a6-be78d6c11af2" (UID: "877276eb-458b-40c3-85a6-be78d6c11af2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:33.068640 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.068535 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-socket" pod "877276eb-458b-40c3-85a6-be78d6c11af2" (UID: "877276eb-458b-40c3-85a6-be78d6c11af2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:33.070307 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.070260 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-kube-api-access-ggw65" pod "877276eb-458b-40c3-85a6-be78d6c11af2" (UID: "877276eb-458b-40c3-85a6-be78d6c11af2"). InnerVolumeSpecName "kube-api-access-ggw65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:24:33.070540 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.070518 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-istio-token" pod "877276eb-458b-40c3-85a6-be78d6c11af2" (UID: "877276eb-458b-40c3-85a6-be78d6c11af2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:24:33.070708 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.070689 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-envoy" pod "877276eb-458b-40c3-85a6-be78d6c11af2" (UID: "877276eb-458b-40c3-85a6-be78d6c11af2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:24:33.070762 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.070703 5219 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/877276eb-458b-40c3-85a6-be78d6c11af2-istio-podinfo" pod "877276eb-458b-40c3-85a6-be78d6c11af2" (UID: "877276eb-458b-40c3-85a6-be78d6c11af2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:24:33.169717 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.169693 5219 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/877276eb-458b-40c3-85a6-be78d6c11af2-istio-podinfo\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:33.169717 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.169714 5219 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-istio-envoy\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:33.169848 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.169728 5219 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggw65\" (UniqueName: \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-kube-api-access-ggw65\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:33.169848 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.169742 5219 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-socket\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:33.169848 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.169750 5219 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/877276eb-458b-40c3-85a6-be78d6c11af2-workload-certs\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:33.169848 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.169759 5219 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/877276eb-458b-40c3-85a6-be78d6c11af2-istio-token\") on node \"ip-10-0-135-225.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:24:33.411564 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.411495 5219 generic.go:356] "Generic (PLEG): container finished" podID="877276eb-458b-40c3-85a6-be78d6c11af2" containerID="5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca" exitCode=0 Nov 04 02:24:33.411564 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.411546 5219 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" Nov 04 02:24:33.411696 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.411579 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" event={"ID":"877276eb-458b-40c3-85a6-be78d6c11af2","Type":"ContainerDied","Data":"5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca"} Nov 04 02:24:33.411696 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.411635 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4" event={"ID":"877276eb-458b-40c3-85a6-be78d6c11af2","Type":"ContainerDied","Data":"07fca6ac3f36b59f9e091ba145ee9db1f8d6420b13014e90531192b654fa055c"} Nov 04 02:24:33.411696 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.411656 5219 scope.go:122] "RemoveContainer" containerID="5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca" Nov 04 02:24:33.420813 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.420796 5219 scope.go:122] "RemoveContainer" containerID="5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca" Nov 04 02:24:33.421064 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:24:33.421047 5219 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca\": container with ID starting with 5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca not found: ID does not exist" containerID="5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca" Nov 04 02:24:33.421107 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.421074 5219 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca"} err="failed to get container status \"5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca\": rpc error: code = NotFound desc = could not find container \"5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca\": container with ID starting with 5e2e633a572a92bbd826eac4f3a7dce4c6e4e5cffe744606c67aa999b69407ca not found: ID does not exist" Nov 04 02:24:33.574087 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.574065 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4"] Nov 04 02:24:33.623494 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:33.623476 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-9adedd-openshift-default-bb77bbbc9-vh2b4"] Nov 04 02:24:34.613154 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:34.613124 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="877276eb-458b-40c3-85a6-be78d6c11af2" path="/var/lib/kubelet/pods/877276eb-458b-40c3-85a6-be78d6c11af2/volumes" Nov 04 02:24:38.928674 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:24:38.928640 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:24:42.184260 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:42.184229 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-6zzb8"] Nov 04 02:24:43.157479 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:43.157452 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-cwztd_ca136539-2665-46ab-8bef-62ba3a90c20e/manager/0.log" Nov 04 02:24:43.455010 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:43.454985 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-txbbr_bf514dd1-1434-4bfd-b61c-f1992fb82ea8/manager/0.log" Nov 04 02:24:46.940964 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:46.940939 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-2280dcfc-hrqc4_b58a393b-139e-4d5f-b396-5f8af95f5990/revoke-keys/0.log" Nov 04 02:24:47.185228 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:47.185196 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-22fc67ff-nn5cf_15eeeb4c-f0e6-443c-981d-15e0ef85dbc2/revoke-keys/0.log" Nov 04 02:24:47.420890 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:47.420839 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-69360ac7-s5xt6_7328bed0-6437-4d3e-a65c-73e3e09a33e5/revoke-keys/0.log" Nov 04 02:24:47.650057 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:47.650036 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-740b5291-zrc6q_a68b0ce8-4f44-4abd-b9f9-869c1632aa5f/revoke-keys/0.log" Nov 04 02:24:47.881408 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:47.881389 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-93bc7083-n998c_10c85d5c-deac-46bc-88bf-856ed8f3aabc/revoke-keys/0.log" Nov 04 02:24:48.134644 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:48.134598 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-9709d391-k8q6f_267f7d43-7ff8-400b-add9-171b9dc562ca/revoke-keys/0.log" Nov 04 02:24:48.377957 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:48.377937 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-a2c552b1-b5tmg_6009d351-8a1e-4d00-89bb-0ef69e30a692/revoke-keys/0.log" Nov 04 02:24:49.525077 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:49.525050 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-d7960fb7-ffl6g_a298da6f-54c2-4b99-941f-5aec312254d2/revoke-keys/0.log" Nov 04 02:24:49.994194 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:49.994166 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-4ctr9_4ede875e-3c40-48d2-a122-fc8fadfdd6c2/postgres/0.log" Nov 04 02:24:53.156052 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:53.156026 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-wlj82_8dd92c9e-2153-46ea-a18a-e94a24eca569/kuadrant-console-plugin/0.log" Nov 04 02:24:54.073839 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:54.073813 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-6zzb8_524477a3-c995-4ce2-b670-d336faf359e9/limitador/0.log" Nov 04 02:24:55.846100 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:55.846071 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-vr682_30ddd80a-29fb-4f92-9fc4-ee58b9b057d4/discovery/0.log" Nov 04 02:24:57.114471 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:24:57.114448 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-plrsv_9cec65b0-de49-43c6-a296-85a3a78ea2c8/istio-proxy/0.log" Nov 04 02:25:08.927834 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:25:08.927801 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:25:13.809504 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:13.809479 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-cwztd_ca136539-2665-46ab-8bef-62ba3a90c20e/manager/0.log" Nov 04 02:25:14.122476 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:14.122411 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-txbbr_bf514dd1-1434-4bfd-b61c-f1992fb82ea8/manager/0.log" Nov 04 02:25:16.690579 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:16.690553 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-2280dcfc-hrqc4_b58a393b-139e-4d5f-b396-5f8af95f5990/revoke-keys/0.log" Nov 04 02:25:17.009454 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:17.009399 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-22fc67ff-nn5cf_15eeeb4c-f0e6-443c-981d-15e0ef85dbc2/revoke-keys/0.log" Nov 04 02:25:17.282381 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:17.282334 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-69360ac7-s5xt6_7328bed0-6437-4d3e-a65c-73e3e09a33e5/revoke-keys/0.log" Nov 04 02:25:17.542155 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:17.542110 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-740b5291-zrc6q_a68b0ce8-4f44-4abd-b9f9-869c1632aa5f/revoke-keys/0.log" Nov 04 02:25:17.800187 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:17.800137 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-93bc7083-n998c_10c85d5c-deac-46bc-88bf-856ed8f3aabc/revoke-keys/0.log" Nov 04 02:25:18.029639 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:18.029618 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-9709d391-k8q6f_267f7d43-7ff8-400b-add9-171b9dc562ca/revoke-keys/0.log" Nov 04 02:25:18.265405 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:18.265385 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-a2c552b1-b5tmg_6009d351-8a1e-4d00-89bb-0ef69e30a692/revoke-keys/0.log" Nov 04 02:25:19.490256 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:19.490236 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-d7960fb7-ffl6g_a298da6f-54c2-4b99-941f-5aec312254d2/revoke-keys/0.log" Nov 04 02:25:19.975156 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:19.975136 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-4ctr9_4ede875e-3c40-48d2-a122-fc8fadfdd6c2/postgres/0.log" Nov 04 02:25:22.243432 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:22.243407 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-wlj82_8dd92c9e-2153-46ea-a18a-e94a24eca569/kuadrant-console-plugin/0.log" Nov 04 02:25:22.990408 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:22.990383 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-6zzb8_524477a3-c995-4ce2-b670-d336faf359e9/limitador/0.log" Nov 04 02:25:24.245467 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:24.245443 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-vr682_30ddd80a-29fb-4f92-9fc4-ee58b9b057d4/discovery/0.log" Nov 04 02:25:25.571955 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:25:25.571892 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-plrsv_9cec65b0-de49-43c6-a296-85a3a78ea2c8/istio-proxy/0.log" Nov 04 02:25:38.928722 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:25:38.928682 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:26:08.927537 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:26:08.927504 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:26:34.059060 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:34.057845 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4"] Nov 04 02:26:34.106494 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:34.106463 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4"] Nov 04 02:26:34.613543 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:34.613518 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b58a393b-139e-4d5f-b396-5f8af95f5990" path="/var/lib/kubelet/pods/b58a393b-139e-4d5f-b396-5f8af95f5990/volumes" Nov 04 02:26:35.052443 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:35.052413 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f"] Nov 04 02:26:35.101666 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:35.101642 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f"] Nov 04 02:26:36.612427 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:36.612400 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="267f7d43-7ff8-400b-add9-171b9dc562ca" path="/var/lib/kubelet/pods/267f7d43-7ff8-400b-add9-171b9dc562ca/volumes" Nov 04 02:26:37.045404 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:37.045380 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6"] Nov 04 02:26:37.094480 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:37.094460 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6"] Nov 04 02:26:38.613194 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:38.613159 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7328bed0-6437-4d3e-a65c-73e3e09a33e5" path="/var/lib/kubelet/pods/7328bed0-6437-4d3e-a65c-73e3e09a33e5/volumes" Nov 04 02:26:38.931224 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:26:38.931193 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor" Nov 04 02:26:43.638243 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:43.638218 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ftvnd_c7cc9b6d-5ad9-4c08-b523-acee6c40a031/global-pull-secret-syncer/0.log" Nov 04 02:26:45.047430 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:45.047400 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf"] Nov 04 02:26:45.096639 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:45.096614 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf"] Nov 04 02:26:46.612528 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:46.612500 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15eeeb4c-f0e6-443c-981d-15e0ef85dbc2" path="/var/lib/kubelet/pods/15eeeb4c-f0e6-443c-981d-15e0ef85dbc2/volumes" Nov 04 02:26:46.695546 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:46.695522 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g52g2_39f89f68-342c-4b27-a499-43c10f62a478/konnectivity-agent/0.log" Nov 04 02:26:47.619585 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:47.619561 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-225.us-west-1.compute.internal_d1c08604dc1c779dd155121103c79330/haproxy/0.log" Nov 04 02:26:50.045665 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:50.045636 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g"] Nov 04 02:26:50.095070 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:50.095048 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g"] Nov 04 02:26:50.613349 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:50.613329 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a298da6f-54c2-4b99-941f-5aec312254d2" path="/var/lib/kubelet/pods/a298da6f-54c2-4b99-941f-5aec312254d2/volumes" Nov 04 02:26:52.044457 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.044429 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg"] Nov 04 02:26:52.093869 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.093846 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg"] Nov 04 02:26:52.612621 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.612590 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6009d351-8a1e-4d00-89bb-0ef69e30a692" path="/var/lib/kubelet/pods/6009d351-8a1e-4d00-89bb-0ef69e30a692/volumes" Nov 04 02:26:52.801016 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.800989 5219 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx"] Nov 04 02:26:52.801267 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801255 5219 cpu_manager.go:414] "containerMap: removing container" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" Nov 04 02:26:52.801331 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801268 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" Nov 04 02:26:52.801331 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801282 5219 cpu_manager.go:414] "containerMap: removing container" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerName="istio-proxy" Nov 04 02:26:52.801331 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801302 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerName="istio-proxy" Nov 04 02:26:52.801331 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801310 5219 cpu_manager.go:414] "containerMap: removing container" podUID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" containerName="istio-proxy" Nov 04 02:26:52.801331 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801315 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" containerName="istio-proxy" Nov 04 02:26:52.801331 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801323 5219 cpu_manager.go:414] "containerMap: removing container" podUID="877276eb-458b-40c3-85a6-be78d6c11af2" containerName="istio-proxy" Nov 04 02:26:52.801331 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801327 5219 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="877276eb-458b-40c3-85a6-be78d6c11af2" containerName="istio-proxy" Nov 04 02:26:52.801559 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801378 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="408600b3-be86-4e51-9c54-cd40eb3ef49e" containerName="istio-proxy" Nov 04 02:26:52.801559 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801385 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="4481cf2c-62ec-4bbd-b40b-264a3f50382b" containerName="istio-proxy" Nov 04 02:26:52.801559 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801390 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="49b7973f-9e9f-49a3-b7eb-d5e5f03a50f0" containerName="istio-proxy" Nov 04 02:26:52.801559 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.801396 5219 memory_manager.go:365] "RemoveStaleState removing state" podUID="877276eb-458b-40c3-85a6-be78d6c11af2" containerName="istio-proxy" Nov 04 02:26:52.805509 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.805496 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:52.857273 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.857254 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pnj78\"/\"kube-root-ca.crt\"" Nov 04 02:26:52.903033 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.902983 5219 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pnj78\"/\"openshift-service-ca.crt\"" Nov 04 02:26:52.906645 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.906612 5219 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pnj78\"/\"default-dockercfg-k64b5\"" Nov 04 02:26:52.907591 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.907573 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx"] Nov 04 02:26:52.919506 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.919481 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-proc\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:52.919599 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.919516 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8w8q\" (UniqueName: \"kubernetes.io/projected/28d51662-4aa3-44d0-86b3-0b0fd2599f33-kube-api-access-r8w8q\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:52.919599 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.919577 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-podres\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:52.919680 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.919606 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-sys\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:52.919680 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:52.919634 5219 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-lib-modules\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.020853 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.020828 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-lib-modules\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.020963 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.020874 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-proc\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.020963 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.020950 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-proc\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.021058 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.020953 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-lib-modules\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.021058 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.020993 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8w8q\" (UniqueName: \"kubernetes.io/projected/28d51662-4aa3-44d0-86b3-0b0fd2599f33-kube-api-access-r8w8q\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.021058 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.021010 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-podres\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.021058 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.021052 5219 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-sys\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.021221 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.021122 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-sys\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.021221 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.021156 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28d51662-4aa3-44d0-86b3-0b0fd2599f33-podres\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.029837 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.029819 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-wlj82_8dd92c9e-2153-46ea-a18a-e94a24eca569/kuadrant-console-plugin/0.log" Nov 04 02:26:53.081451 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.081435 5219 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8w8q\" (UniqueName: \"kubernetes.io/projected/28d51662-4aa3-44d0-86b3-0b0fd2599f33-kube-api-access-r8w8q\") pod \"perf-node-gather-daemonset-gs2hx\" (UID: \"28d51662-4aa3-44d0-86b3-0b0fd2599f33\") " pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.116834 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.116814 5219 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:53.484321 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.484277 5219 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx"] Nov 04 02:26:53.488060 ip-10-0-135-225 kubenswrapper[5219]: W1104 02:26:53.488029 5219 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod28d51662_4aa3_44d0_86b3_0b0fd2599f33.slice/crio-58ce3fa8619ab5e3d254581bd2dc410b6d1323aede5d6ced8de94df21ea5f369 WatchSource:0}: Error finding container 58ce3fa8619ab5e3d254581bd2dc410b6d1323aede5d6ced8de94df21ea5f369: Status 404 returned error can't find the container with id 58ce3fa8619ab5e3d254581bd2dc410b6d1323aede5d6ced8de94df21ea5f369 Nov 04 02:26:53.968242 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.968210 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" event={"ID":"28d51662-4aa3-44d0-86b3-0b0fd2599f33","Type":"ContainerStarted","Data":"10774598e6c0e3eb235d5f9d76d855c1eaaaf993ede040ba5d7a7b4901729eca"} Nov 04 02:26:53.968413 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.968340 5219 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" event={"ID":"28d51662-4aa3-44d0-86b3-0b0fd2599f33","Type":"ContainerStarted","Data":"58ce3fa8619ab5e3d254581bd2dc410b6d1323aede5d6ced8de94df21ea5f369"} Nov 04 02:26:53.968611 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:53.968585 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:26:54.027911 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:54.027886 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-6zzb8_524477a3-c995-4ce2-b670-d336faf359e9/limitador/0.log" Nov 04 02:26:56.045491 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:56.045404 5219 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" podStartSLOduration=4.045391388 podStartE2EDuration="4.045391388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:26:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:54.082585185 +0000 UTC m=+1159.571094072" watchObservedRunningTime="2026-11-04 02:26:56.045391388 +0000 UTC m=+1161.533900087" Nov 04 02:26:56.045949 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:56.045932 5219 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c"] Nov 04 02:26:56.095166 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:56.095136 5219 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c"] Nov 04 02:26:56.613180 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:56.613159 5219 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10c85d5c-deac-46bc-88bf-856ed8f3aabc" path="/var/lib/kubelet/pods/10c85d5c-deac-46bc-88bf-856ed8f3aabc/volumes" Nov 04 02:26:57.169027 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:57.168995 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61936444-21d0-45a0-b2b2-57cdcd514f3a/alertmanager/0.log" Nov 04 02:26:57.587349 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:57.587327 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61936444-21d0-45a0-b2b2-57cdcd514f3a/config-reloader/0.log" Nov 04 02:26:58.008195 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:58.008172 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61936444-21d0-45a0-b2b2-57cdcd514f3a/kube-rbac-proxy-web/0.log" Nov 04 02:26:58.428807 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:58.428791 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61936444-21d0-45a0-b2b2-57cdcd514f3a/kube-rbac-proxy/0.log" Nov 04 02:26:58.847526 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:58.847475 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61936444-21d0-45a0-b2b2-57cdcd514f3a/kube-rbac-proxy-metric/0.log" Nov 04 02:26:59.266117 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:59.266092 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61936444-21d0-45a0-b2b2-57cdcd514f3a/prom-label-proxy/0.log" Nov 04 02:26:59.686144 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:59.686121 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61936444-21d0-45a0-b2b2-57cdcd514f3a/init-config-reloader/0.log" Nov 04 02:26:59.983193 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:26:59.983114 5219 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pnj78/perf-node-gather-daemonset-gs2hx" Nov 04 02:27:02.699748 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:27:02.699725 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kv495_11c1b4b3-e146-441c-b2e1-7ce37ba61863/node-exporter/0.log" Nov 04 02:27:03.117274 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:27:03.117221 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kv495_11c1b4b3-e146-441c-b2e1-7ce37ba61863/kube-rbac-proxy/0.log" Nov 04 02:27:03.548011 ip-10-0-135-225 kubenswrapper[5219]: I1104 02:27:03.547989 5219 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kv495_11c1b4b3-e146-441c-b2e1-7ce37ba61863/init-textfile/0.log" Nov 04 02:27:08.927805 ip-10-0-135-225 kubenswrapper[5219]: E1104 02:27:08.927775 5219 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-8f6tb" containerName="extractor"