Nov 04 01:33:55.796378 ip-10-0-135-4 systemd[1]: Starting Kubernetes Kubelet... Nov 04 01:33:56.158440 ip-10-0-135-4 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 01:33:56.158440 ip-10-0-135-4 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 01:33:56.158440 ip-10-0-135-4 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 01:33:56.158440 ip-10-0-135-4 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 01:33:56.162887 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162795 2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:33:56.162887 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162887 2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:33:56.162887 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162892 2572 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162895 2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162898 2572 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162901 2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162904 2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162907 2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162910 2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162913 2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162916 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162918 2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162921 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162924 2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162927 2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162929 2572 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162932 2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162935 2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162938 2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162941 2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162943 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162946 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:33:56.162985 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162948 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162951 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162955 2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162959 2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162963 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162965 2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162969 2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162972 2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162974 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162977 2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162980 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162983 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162986 2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162989 2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162994 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162997 2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.162999 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163002 2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163005 2572 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:33:56.163516 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163008 2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163010 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163013 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163016 2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163019 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163021 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163024 2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163027 2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163029 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163032 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163035 2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163037 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163040 2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163042 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163045 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163047 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163050 2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163052 2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163055 2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163058 2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:33:56.163960 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163062 2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163065 2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163068 2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163089 2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163092 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163095 2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163098 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163101 2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163103 2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163106 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163109 2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163111 2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163114 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163117 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163120 2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163123 2572 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163126 2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163129 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163132 2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163135 2572 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:33:56.164482 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163137 2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163140 2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163142 2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163145 2572 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163148 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163150 2572 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163153 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163156 2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163158 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163163 2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163167 2572 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163171 2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163174 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163176 2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163179 2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163182 2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163184 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163187 2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163190 2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:33:56.164949 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163193 2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163195 2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163198 2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163202 2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163205 2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.163207 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164046 2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164054 2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164057 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164060 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164063 2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164067 2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164087 2572 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164092 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164095 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164098 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164101 2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164104 2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164107 2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164109 2572 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:33:56.165410 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164114 2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164117 2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164120 2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164122 2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164125 2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164127 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164130 2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164132 2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164136 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164138 2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164141 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164144 2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164147 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164149 2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164152 2572 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164154 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164157 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164160 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164163 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:33:56.165894 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164165 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164168 2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164170 2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164173 2572 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164176 2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164179 2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164182 2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164185 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164187 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164190 2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164192 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164195 2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164197 2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164200 2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164203 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164205 2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164208 2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164210 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164213 2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164215 2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:33:56.166369 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164218 2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164221 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164224 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164227 2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164230 2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164232 2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164235 2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164237 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164240 2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164243 2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164246 2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164248 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164251 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164255 2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164259 2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164262 2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164265 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164267 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164271 2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164273 2572 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:33:56.166843 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164276 2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164278 2572 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164281 2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164283 2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164286 2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164288 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164291 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164294 2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164296 2572 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164299 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164301 2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164305 2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164308 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164310 2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164314 2572 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164316 2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164319 2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164322 2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164325 2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164327 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:33:56.167377 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164330 2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164333 2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164337 2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164341 2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164344 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164347 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164349 2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164352 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164355 2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164358 2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164360 2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164365 2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164367 2572 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164897 2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164903 2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164906 2572 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164909 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164912 2572 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164915 2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:33:56.167846 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164918 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164921 2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164924 2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164926 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164929 2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164931 2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164935 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164938 2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164941 2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164944 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164947 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164950 2572 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164952 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164956 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164959 2572 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164962 2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164964 2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164967 2572 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164969 2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164972 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:33:56.168314 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164975 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164977 2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164980 2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164982 2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164985 2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164988 2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164990 2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164993 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164996 2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.164998 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165001 2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165003 2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165006 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165008 2572 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165011 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165016 2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165018 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165020 2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165023 2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:33:56.168787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165027 2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165029 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165032 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165035 2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165037 2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165040 2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165043 2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165045 2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165047 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165050 2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165052 2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165055 2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165058 2572 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165060 2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165063 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165065 2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165068 2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165091 2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165094 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165097 2572 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:33:56.169267 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165100 2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165103 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165105 2572 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165108 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165111 2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165113 2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165116 2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165119 2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165123 2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165125 2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165128 2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165133 2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165135 2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165138 2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165141 2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165143 2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165147 2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165152 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165155 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:33:56.169730 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165157 2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165160 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165162 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165165 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165167 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165171 2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165174 2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165177 2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165180 2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165183 2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165186 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165188 2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165193 2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165195 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165198 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165200 2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165203 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165205 2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165208 2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:33:56.170184 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165210 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165213 2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.165217 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166102 2572 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166113 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166120 2572 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166125 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166129 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166133 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166138 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166142 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166146 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166149 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166152 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166156 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166159 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166162 2572 flags.go:64] FLAG: --cgroup-root="" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166165 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166168 2572 flags.go:64] FLAG: --client-ca-file="" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166171 2572 flags.go:64] FLAG: --cloud-provider="external" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166174 2572 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166180 2572 flags.go:64] FLAG: --cluster-domain="" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166183 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 01:33:56.170626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166186 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166189 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166193 2572 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166198 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166201 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166204 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166208 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166211 2572 flags.go:64] FLAG: --contention-profiling="false" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166215 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166218 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166222 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166227 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166231 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166235 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166238 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166242 2572 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166245 2572 flags.go:64] FLAG: --enable-server="true" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166248 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166252 2572 flags.go:64] FLAG: --event-burst="100" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166256 2572 flags.go:64] FLAG: --event-qps="50" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166259 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166262 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166265 2572 flags.go:64] FLAG: --eviction-hard="" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166269 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 01:33:56.171167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166272 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166275 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166278 2572 flags.go:64] FLAG: --eviction-soft="" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166282 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166285 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166288 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166291 2572 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166294 2572 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166297 2572 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166300 2572 flags.go:64] FLAG: --feature-gates="" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166305 2572 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166308 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166312 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166315 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166319 2572 flags.go:64] FLAG: --healthz-port="10248" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166322 2572 flags.go:64] FLAG: --help="false" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166325 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166328 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166332 2572 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166336 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166340 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166344 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166347 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 01:33:56.171780 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166350 2572 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166353 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166356 2572 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166359 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166362 2572 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166365 2572 flags.go:64] FLAG: --kube-reserved="" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166368 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166371 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166374 2572 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166377 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166380 2572 flags.go:64] FLAG: --lock-file="" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166383 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166386 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166390 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166396 2572 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166399 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166402 2572 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166405 2572 flags.go:64] FLAG: --logging-format="text" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166408 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166411 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166414 2572 flags.go:64] FLAG: --manifest-url="" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166417 2572 flags.go:64] FLAG: --manifest-url-header="" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166423 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166426 2572 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166430 2572 flags.go:64] FLAG: --max-pods="110" Nov 04 01:33:56.172339 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166433 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166436 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166439 2572 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166443 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166446 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166451 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166454 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166462 2572 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166465 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166468 2572 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166472 2572 flags.go:64] FLAG: --pod-cidr="" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166474 2572 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166477 2572 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166480 2572 flags.go:64] FLAG: --pods-per-core="0" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166483 2572 flags.go:64] FLAG: --port="10250" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166486 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166489 2572 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-085ce3a0a47c5dcf0" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166492 2572 flags.go:64] FLAG: --qos-reserved="" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166496 2572 flags.go:64] FLAG: --read-only-port="10255" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166499 2572 flags.go:64] FLAG: --register-node="true" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166502 2572 flags.go:64] FLAG: --register-with-taints="" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166506 2572 flags.go:64] FLAG: --registry-burst="10" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166509 2572 flags.go:64] FLAG: --registry-qps="5" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166511 2572 flags.go:64] FLAG: --reserved-cpus="" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166514 2572 flags.go:64] FLAG: --reserved-memory="" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166518 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 01:33:56.172927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166521 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166524 2572 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166527 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166530 2572 flags.go:64] FLAG: --runonce="false" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166534 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166537 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166540 2572 flags.go:64] FLAG: --seccomp-default="false" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166543 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166546 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166550 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166554 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166558 2572 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166561 2572 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166564 2572 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166567 2572 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166570 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166573 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166576 2572 flags.go:64] FLAG: --system-cgroups="" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166579 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166585 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166588 2572 flags.go:64] FLAG: --tls-cert-file="" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166591 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166596 2572 flags.go:64] FLAG: --tls-min-version="" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166599 2572 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166602 2572 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 01:33:56.173751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166605 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166608 2572 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166612 2572 flags.go:64] FLAG: --v="2" Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166623 2572 flags.go:64] FLAG: --version="false" Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166627 2572 flags.go:64] FLAG: --vmodule="" Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166631 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.166634 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166779 2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166783 2572 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166786 2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166789 2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166792 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166795 2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166798 2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166800 2572 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166803 2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166806 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166809 2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166813 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166817 2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:33:56.174663 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166821 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166823 2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166826 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166829 2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166831 2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166834 2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166836 2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166839 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166842 2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166845 2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166848 2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166851 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166853 2572 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166856 2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166859 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166862 2572 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166864 2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166867 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166869 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:33:56.175158 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166872 2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166874 2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166877 2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166880 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166882 2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166885 2572 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166888 2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166891 2572 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166893 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166897 2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166899 2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166903 2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166906 2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166908 2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166911 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166914 2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166916 2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166919 2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166921 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166924 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:33:56.175939 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166927 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166929 2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166931 2572 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166934 2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166937 2572 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166939 2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166941 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166944 2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166947 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166949 2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166952 2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166957 2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166960 2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166963 2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166966 2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166968 2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166971 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166973 2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166976 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166979 2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:33:56.176787 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166982 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166984 2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166987 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166991 2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166994 2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166996 2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.166999 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167001 2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167004 2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167006 2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167009 2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167012 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167014 2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167017 2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167019 2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167022 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167025 2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167027 2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167030 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:33:56.177711 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167032 2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167035 2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167038 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167040 2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167043 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167046 2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167048 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167051 2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167053 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167056 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167058 2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167061 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167063 2572 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167066 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167085 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.167116 2572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 01:33:56.178575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167169 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167175 2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167178 2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167181 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167183 2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167186 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167189 2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167191 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167194 2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167197 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167199 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167202 2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167204 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167207 2572 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167210 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167213 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167215 2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167225 2572 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167228 2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167231 2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:33:56.179092 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167233 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167236 2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167239 2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167241 2572 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167244 2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167247 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167249 2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167252 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167256 2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167260 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167264 2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167267 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167269 2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167275 2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167277 2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167280 2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167283 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167285 2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167288 2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:33:56.179700 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167290 2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167293 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167295 2572 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167298 2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167301 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167303 2572 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167306 2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167308 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167311 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167314 2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167316 2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167319 2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167321 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167324 2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167329 2572 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167333 2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167335 2572 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167338 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167340 2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167343 2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:33:56.180481 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167345 2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167348 2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167350 2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167353 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167356 2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167359 2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167363 2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167365 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167368 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167370 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167373 2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167375 2572 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167378 2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167381 2572 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167384 2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167386 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167389 2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167391 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167394 2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167397 2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:33:56.181200 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167401 2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167404 2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167407 2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167410 2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167413 2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167415 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167419 2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167422 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167424 2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167427 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167429 2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167432 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167434 2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167437 2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167439 2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167442 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167444 2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167447 2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167451 2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167453 2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:33:56.181826 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167457 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167459 2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167462 2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167464 2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167467 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167469 2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.167472 2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.176591 2572 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.176613 2572 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.176628 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.176635 2572 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176724 2572 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176733 2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176738 2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176743 2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176748 2572 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176753 2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176757 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176762 2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176767 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:33:56.182340 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176771 2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176776 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176780 2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176784 2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176788 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176793 2572 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176797 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176801 2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176805 2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176810 2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176815 2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176819 2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176824 2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176831 2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176838 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176844 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176849 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176853 2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176858 2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:33:56.182865 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176863 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176870 2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176876 2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176880 2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176884 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176889 2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176893 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176898 2572 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176902 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176907 2572 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176911 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176915 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176920 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176924 2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176928 2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176933 2572 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176937 2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176942 2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176946 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176951 2572 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:33:56.183473 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176955 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176959 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176964 2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176969 2572 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176973 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176977 2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176981 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176985 2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176990 2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176994 2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.176998 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177004 2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177008 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177013 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177017 2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177021 2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177025 2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177029 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177034 2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177038 2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:33:56.184009 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177043 2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177047 2572 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177051 2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177055 2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177059 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177064 2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177087 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177092 2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177096 2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177100 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177107 2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177113 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177119 2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177123 2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177128 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177133 2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177138 2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177143 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177147 2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:33:56.184539 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177152 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177156 2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177160 2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177165 2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177169 2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177174 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177178 2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177183 2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177187 2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177192 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177197 2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177201 2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177205 2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177210 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177214 2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177218 2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177222 2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177226 2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:33:56.185310 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177231 2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.177277 2572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177505 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177513 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177518 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177522 2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177527 2572 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177531 2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177536 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177539 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177544 2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177548 2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177554 2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177559 2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177563 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:33:56.185995 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177567 2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177572 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177576 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177580 2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177584 2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177589 2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177593 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177597 2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177602 2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177606 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177611 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177615 2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177619 2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177624 2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177628 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177633 2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177638 2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177642 2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177647 2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:33:56.186491 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177651 2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177655 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177662 2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177669 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177674 2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177679 2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177684 2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177688 2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177692 2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177696 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177701 2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177706 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177710 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177714 2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177719 2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177723 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177727 2572 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177731 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177736 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177740 2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:33:56.187280 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177745 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177749 2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177754 2572 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177758 2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177762 2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177766 2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177771 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177775 2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177779 2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177783 2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177788 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177792 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177797 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177802 2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177806 2572 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177810 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177815 2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177819 2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177823 2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:33:56.187892 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177828 2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177833 2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177837 2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177842 2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177848 2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177856 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177860 2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177864 2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177869 2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177873 2572 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177878 2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177883 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177887 2572 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177891 2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177895 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177899 2572 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177903 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177907 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177912 2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177916 2572 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:33:56.188413 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177920 2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177924 2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177929 2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177933 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177937 2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177947 2572 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177951 2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177955 2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177959 2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177964 2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177968 2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177973 2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177977 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177981 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.177985 2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.178026 2572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 01:33:56.188891 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178107 2572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178116 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178122 2572 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178126 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178131 2572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178135 2572 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178139 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178144 2572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178148 2572 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178152 2572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178157 2572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178161 2572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178165 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178170 2572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178174 2572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178178 2572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178182 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178187 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178192 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178196 2572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:33:56.189286 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178200 2572 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178207 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178211 2572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178215 2572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178220 2572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178224 2572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178229 2572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178233 2572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178237 2572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178244 2572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178249 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178254 2572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178258 2572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178262 2572 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178268 2572 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178273 2572 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178277 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178282 2572 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178286 2572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:33:56.189742 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178290 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178295 2572 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178300 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178304 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178308 2572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178313 2572 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178317 2572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178321 2572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178326 2572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178330 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178334 2572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178338 2572 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178342 2572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178347 2572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178352 2572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178356 2572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178361 2572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178365 2572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178370 2572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178374 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:33:56.190261 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178379 2572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178383 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178387 2572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178391 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178395 2572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178399 2572 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178404 2572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178409 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178413 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178418 2572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178422 2572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178428 2572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178432 2572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178437 2572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178441 2572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178445 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178449 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178453 2572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178457 2572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:33:56.190927 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178462 2572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178466 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178470 2572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178474 2572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178479 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178483 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178487 2572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178493 2572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178498 2572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178502 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178506 2572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178511 2572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178515 2572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178520 2572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178524 2572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178528 2572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178536 2572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178542 2572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178547 2572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:33:56.191462 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178553 2572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178557 2572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178562 2572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178566 2572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178572 2572 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178578 2572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178582 2572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178587 2572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:56.178591 2572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.178680 2572 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.181626 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.182702 2572 server.go:1014] "Starting client certificate rotation" Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.182806 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.182843 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.185280 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 01:33:56.191903 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.190976 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 01:33:56.203713 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.203692 2572 log.go:25] "Validated CRI v1 runtime API" Nov 04 01:33:56.207519 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.207497 2572 log.go:25] "Validated CRI v1 image API" Nov 04 01:33:56.208392 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.208370 2572 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 01:33:56.213138 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.213109 2572 fs.go:135] Filesystem UUIDs: map[3bf8c763-c612-4654-b952-7f67561f2026:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ebba7584-4719-4ebb-be50-05d4f5001d6b:/dev/nvme0n1p3] Nov 04 01:33:56.213214 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.213137 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 04 01:33:56.218523 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.218391 2572 manager.go:217] Machine: {Timestamp:2026-11-04 01:33:56.216958713 +0000 UTC m=+0.323258347 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3061958 MemoryCapacity:32812011520 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b66e8c07a8542a21293d42403d0f8 SystemUUID:ec2b66e8-c07a-8542-a212-93d42403d0f8 BootID:e90fbc49-6670-465e-ba71-6f3f62ddabe7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406003712 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:72:61:39:e1:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:72:61:39:e1:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:26:64:55:86:3c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812011520 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 01:33:56.219245 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.219230 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 01:33:56.219401 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.219383 2572 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 01:33:56.222917 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.222887 2572 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 01:33:56.223052 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.222919 2572 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-4.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 01:33:56.223110 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.223055 2572 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 01:33:56.223110 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.223062 2572 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 01:33:56.223177 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.223122 2572 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 01:33:56.223177 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.223140 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 01:33:56.224396 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.224385 2572 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 01:33:56.228868 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.228855 2572 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 01:33:56.228982 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.228973 2572 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 01:33:56.229794 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.229784 2572 kubelet.go:493] "Attempting to sync node with API server" Nov 04 01:33:56.229840 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.229799 2572 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 01:33:56.229840 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.229810 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 01:33:56.229840 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.229819 2572 kubelet.go:405] "Adding apiserver pod source" Nov 04 01:33:56.229840 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.229827 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 01:33:56.230186 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.230173 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 01:33:56.232451 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.232431 2572 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 01:33:56.239488 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.239472 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 01:33:56.240388 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.240375 2572 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 01:33:56.240442 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.240407 2572 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 01:33:56.240559 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.240549 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 01:33:56.240590 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.240565 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 01:33:56.240590 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.240571 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 01:33:56.240590 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.240577 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 01:33:56.240590 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.240582 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 01:33:56.240590 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.240588 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 01:33:56.241256 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.241245 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 01:33:56.241294 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.241258 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 01:33:56.241294 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.241266 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 01:33:56.241294 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.241272 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 01:33:56.241294 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.241281 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 01:33:56.241294 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.241290 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 01:33:56.242850 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.242838 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 01:33:56.242884 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.242854 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 01:33:56.246861 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.246847 2572 server.go:1263] "Started kubelet" Nov 04 01:33:56.247001 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.246964 2572 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 01:33:56.247165 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.246984 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 01:33:56.247250 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.247190 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 01:33:56.247789 ip-10-0-135-4 systemd[1]: Started Kubernetes Kubelet. Nov 04 01:33:56.248904 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.248895 2572 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 01:33:56.253783 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:56.253756 2572 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 04 01:33:56.253911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.253810 2572 server.go:317] "Adding debug handlers to kubelet server" Nov 04 01:33:56.259062 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.259046 2572 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 01:33:56.259062 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.259058 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 01:33:56.259243 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:56.259146 2572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-4.us-west-1.compute.internal\" not found" Nov 04 01:33:56.259979 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.259963 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 01:33:56.260129 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260114 2572 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 01:33:56.260219 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260133 2572 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 01:33:56.260277 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260255 2572 reconstruct.go:97] "Volume reconstruction finished" Nov 04 01:33:56.260277 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260264 2572 reconciler.go:29] "Reconciler: start to sync state" Nov 04 01:33:56.260477 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260456 2572 factory.go:55] Registering systemd factory Nov 04 01:33:56.260477 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260478 2572 factory.go:223] Registration of the systemd container factory successfully Nov 04 01:33:56.260818 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260788 2572 factory.go:153] Registering CRI-O factory Nov 04 01:33:56.260818 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260815 2572 factory.go:223] Registration of the crio container factory successfully Nov 04 01:33:56.260933 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260870 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 01:33:56.260933 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260888 2572 factory.go:103] Registering Raw factory Nov 04 01:33:56.260933 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.260900 2572 manager.go:1199] Started watching for new ooms in manager Nov 04 01:33:56.262017 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.262001 2572 manager.go:319] Starting recovery of all containers Nov 04 01:33:56.271982 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.271964 2572 manager.go:324] Recovery completed Nov 04 01:33:56.277158 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.277145 2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 01:33:56.278855 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.278836 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 01:33:56.278949 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.278874 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 01:33:56.278949 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.278891 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 01:33:56.279451 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.279440 2572 cpu_manager.go:226] "Starting" policy="none" Nov 04 01:33:56.279451 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.279450 2572 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 01:33:56.279539 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.279466 2572 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 01:33:56.279539 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.279497 2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 01:33:56.280191 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.280177 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 01:33:56.280244 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.280202 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 01:33:56.280244 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.280213 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 01:33:56.281715 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.281703 2572 policy_none.go:50] "Start" Nov 04 01:33:56.281749 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.281720 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 01:33:56.281749 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.281730 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 01:33:56.283729 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.283716 2572 policy_none.go:44] "Start" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.334759 2572 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.339201 2572 manager.go:341] "Starting Device Plugin manager" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:56.339240 2572 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.339252 2572 server.go:87] "Starting device plugin registration server" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.339558 2572 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.339572 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.339634 2572 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.339706 2572 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.339714 2572 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:56.340323 2572 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:56.340385 2572 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-4.us-west-1.compute.internal\" not found" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.341651 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.342925 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.342945 2572 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.342963 2572 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 01:33:56.345371 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:56.342993 2572 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 04 01:33:56.390202 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:56.390162 2572 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-4.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 04 01:33:56.390202 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.390166 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-4.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 04 01:33:56.391259 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:56.390149 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-4.us-west-1.compute.internal.18e4b39c7a342e59 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-4.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-4.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 01:33:56.246810201 +0000 UTC m=+0.353109834,LastTimestamp:2026-11-04 01:33:56.246810201 +0000 UTC m=+0.353109834,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-4.us-west-1.compute.internal,}" Nov 04 01:33:56.440172 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.440107 2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 01:33:56.441982 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.441961 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 01:33:56.442119 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.441998 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 01:33:56.442119 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.442013 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 01:33:56.442119 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.442045 2572 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.443664 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.443645 2572 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal"] Nov 04 01:33:56.443745 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.443708 2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 01:33:56.444456 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.444439 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 01:33:56.444509 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.444468 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 01:33:56.444540 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.444515 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 01:33:56.446699 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.446686 2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 01:33:56.446841 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.446825 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.446881 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.446856 2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 01:33:56.447483 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.447469 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 01:33:56.447538 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.447471 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 01:33:56.447538 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.447502 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 01:33:56.447538 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.447516 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 01:33:56.447538 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.447532 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 01:33:56.447653 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.447545 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 01:33:56.449661 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.449647 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.449719 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.449673 2572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 01:33:56.450726 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.450711 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 01:33:56.450791 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.450736 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 01:33:56.450791 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.450749 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 01:33:56.463511 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.463493 2572 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 01:33:56.463576 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.463567 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dfcks" Nov 04 01:33:56.484877 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:56.484856 2572 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-4.us-west-1.compute.internal\" not found" node="ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.492119 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:56.492101 2572 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-4.us-west-1.compute.internal\" not found" node="ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.551196 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.551174 2572 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:33:56.552645 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.552630 2572 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:33:56.561413 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.561394 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9d6b8a5b75c98b7e9c979c9bafacea9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"c9d6b8a5b75c98b7e9c979c9bafacea9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.561461 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.561419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.561461 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.561439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.650758 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.650725 2572 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:33:56.652060 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.652044 2572 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:33:56.652227 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.652197 2572 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.659601 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.659582 2572 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.661786 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.661768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9d6b8a5b75c98b7e9c979c9bafacea9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"c9d6b8a5b75c98b7e9c979c9bafacea9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.661869 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.661793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.661869 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.661810 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.661943 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.661874 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.661943 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.661884 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.661943 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.661874 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9d6b8a5b75c98b7e9c979c9bafacea9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"c9d6b8a5b75c98b7e9c979c9bafacea9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.722621 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.722552 2572 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 01:33:56.722722 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.722671 2572 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.778213 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.778183 2572 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 01:33:56.789293 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.789273 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:56.797337 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:56.797317 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:33:57.182116 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.182065 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 04 01:33:57.182632 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.182262 2572 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 01:33:57.182632 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.182287 2572 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 01:33:57.182632 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.182303 2572 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 01:33:57.182632 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.182305 2572 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://aa64b852660404cf9a45925727badae8-e04a1860fe467e96.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-135-4.us-west-1.compute.internal.18e4b39c7c1dcae9\": read tcp 10.0.135.4:56166->3.139.49.167:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-135-4.us-west-1.compute.internal.18e4b39c7c1dcae9 default 5041 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-4.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-4.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-4.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 01:33:56 +0000 UTC,LastTimestamp:2026-11-04 01:33:56.442018326 +0000 UTC m=+0.548317966,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-4.us-west-1.compute.internal,}" Nov 04 01:33:57.230605 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.230568 2572 apiserver.go:52] "Watching apiserver" Nov 04 01:33:57.260738 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.260706 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 04 01:33:57.469497 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.469406 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 01:28:58 +0000 UTC" deadline="2028-07-14 03:26:01.560697448 +0000 UTC" Nov 04 01:33:57.469497 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.469444 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14833h52m4.091255996s" Nov 04 01:33:57.499990 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.499959 2572 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 01:33:57.500338 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.500315 2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal","openshift-network-diagnostics/network-check-target-nwps2","openshift-network-operator/iptables-alerter-snwbg","openshift-ovn-kubernetes/ovnkube-node-k9jb7","openshift-cluster-node-tuning-operator/tuned-h46h5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal","openshift-multus/network-metrics-daemon-2kbxl","openshift-dns/node-resolver-7dt2n","openshift-image-registry/node-ca-klpkr","kube-system/global-pull-secret-syncer-rghpj","kube-system/konnectivity-agent-c55hv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg","openshift-multus/multus-9nnr8","openshift-multus/multus-additional-cni-plugins-g7rmq"] Nov 04 01:33:57.502616 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.502602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:33:57.502696 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.502679 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:33:57.504552 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.504539 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.506660 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.506642 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.508633 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.508614 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.510626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.510608 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:33:57.510712 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.510683 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:33:57.512673 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.512656 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.514588 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.514569 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.517163 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.516867 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:33:57.517163 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.516944 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:33:57.519174 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.519156 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:33:57.521398 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.521379 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.523506 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.523490 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.525711 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.525697 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.557706 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.557689 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 01:33:57.557797 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.557729 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 01:33:57.557797 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.557732 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 01:33:57.557897 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.557828 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lhd4j\"" Nov 04 01:33:57.564372 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.564354 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 01:33:57.565410 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjdw8\" (UniqueName: \"kubernetes.io/projected/19603f03-3a29-404a-945e-7c489370a778-kube-api-access-gjdw8\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:33:57.565476 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cnibin\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.565476 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565433 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-host-slash\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.565476 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565449 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-tuned\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.565476 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565463 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-sys-fs\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.565671 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-hostroot\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.565671 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-kubelet\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.565671 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565588 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-run\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.565671 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-host\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.565671 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565649 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwzh7\" (UniqueName: \"kubernetes.io/projected/07394429-d52a-4e4f-bf9d-9b33be514f87-kube-api-access-nwzh7\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.565896 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565735 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a7f110b-9d5e-43a1-832e-0066909fcb5e-serviceca\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.565896 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565771 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.565896 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-device-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.565896 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565801 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.565896 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-systemd-units\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.565896 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565889 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-conf\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.566135 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a7f110b-9d5e-43a1-832e-0066909fcb5e-host\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.566135 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-system-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.566135 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.565978 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-etc-kubernetes\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.566135 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566024 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.566135 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566054 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-log-socket\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.566135 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566098 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-system-cni-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.566333 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566142 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfkqc\" (UniqueName: \"kubernetes.io/projected/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-kube-api-access-cfkqc\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.566333 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566190 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqkzc\" (UniqueName: \"kubernetes.io/projected/8a7f110b-9d5e-43a1-832e-0066909fcb5e-kube-api-access-rqkzc\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.566333 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566227 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-slash\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.566333 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566255 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:33:57.566333 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566295 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-kubernetes\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.566333 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7455j\" (UniqueName: \"kubernetes.io/projected/7780d59b-2c7e-4662-89c8-4414580ee652-kube-api-access-7455j\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.566333 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.566581 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8950ff39-1eba-4849-a3fe-b351b2022c0e-tmp-dir\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.566581 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566398 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-tmp\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.566581 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-node-log\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.566581 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566475 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovn-node-metrics-cert\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.566581 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566503 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxb82\" (UniqueName: \"kubernetes.io/projected/8950ff39-1eba-4849-a3fe-b351b2022c0e-kube-api-access-hxb82\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.566581 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-kubelet-config\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:33:57.566581 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-sys\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.566581 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566579 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f700ff69-3257-4068-8eb2-807a7b9f150b-konnectivity-ca\") pod \"konnectivity-agent-c55hv\" (UID: \"f700ff69-3257-4068-8eb2-807a7b9f150b\") " pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-etc-selinux\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566632 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-k8s-cni-cncf-io\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566648 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-conf-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-etc-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566702 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-cni-binary-copy\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566730 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-socket-dir-parent\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-bin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566790 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-var-lib-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566824 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-dbus\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566850 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566873 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-registration-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.566907 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566904 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-netns\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566929 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-multus-daemon-config\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566957 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-netd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.566994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-script-lib\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567102 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8950ff39-1eba-4849-a3fe-b351b2022c0e-hosts-file\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-cnibin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pvrf\" (UniqueName: \"kubernetes.io/projected/1080d3e1-b834-48f5-b2aa-28e01af0bff5-kube-api-access-2pvrf\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567195 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-iptables-alerter-script\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567249 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-modprobe-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wqvn\" (UniqueName: \"kubernetes.io/projected/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kube-api-access-8wqvn\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.567303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-netns\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-socket-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567335 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-multus\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567372 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-kubelet\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567397 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-bin\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567421 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-config\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567474 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567516 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-systemd\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-lib-modules\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfqkn\" (UniqueName: \"kubernetes.io/projected/a4f4c9d8-be23-48ea-a760-403fad2fa67b-kube-api-access-gfqkn\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f700ff69-3257-4068-8eb2-807a7b9f150b-agent-certs\") pod \"konnectivity-agent-c55hv\" (UID: \"f700ff69-3257-4068-8eb2-807a7b9f150b\") " pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567665 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-ovn\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567692 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysconfig\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567714 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-var-lib-kubelet\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.567813 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-multus-certs\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.568400 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567805 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-systemd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.568400 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.567829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-env-overrides\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.653759 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.653736 2572 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 01:33:57.653875 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.653798 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pxrqz" Nov 04 01:33:57.658839 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.658815 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 01:33:57.658839 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.658818 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 01:33:57.659044 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659032 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 01:33:57.659115 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659094 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 01:33:57.659205 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659141 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 01:33:57.659205 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659146 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 01:33:57.659205 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659198 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 01:33:57.659405 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659205 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 01:33:57.659405 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659243 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5jndn\"" Nov 04 01:33:57.659405 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659251 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 01:33:57.659405 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659281 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xwn9r\"" Nov 04 01:33:57.659405 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659290 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 01:33:57.659405 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659335 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 01:33:57.659405 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659389 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 01:33:57.659405 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659390 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 01:33:57.659405 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659410 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 01:33:57.659677 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659415 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 01:33:57.659677 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659422 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 01:33:57.659677 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659432 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 01:33:57.659677 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659466 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ctj2f\"" Nov 04 01:33:57.659677 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659475 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-shfxh\"" Nov 04 01:33:57.659677 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.659475 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 01:33:57.667291 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.667274 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 01:33:57.667361 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.667291 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 01:33:57.667361 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.667306 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 01:33:57.667361 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.667294 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 01:33:57.668519 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668504 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-bin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.668563 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-var-lib-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.668563 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-dbus\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:33:57.668640 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668561 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:33:57.668640 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668576 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-registration-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.668640 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668596 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-netns\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.668640 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668607 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-var-lib-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.668640 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668613 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-bin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.668640 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668640 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-netns\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668678 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-registration-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668680 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-dbus\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.668685 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-multus-daemon-config\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.668795 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret podName:a265f44c-4a61-4dae-a06d-55472c7bdf21 nodeName:}" failed. No retries permitted until 2026-11-04 01:33:58.168772849 +0000 UTC m=+2.275072484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret") pod "global-pull-secret-syncer-rghpj" (UID: "a265f44c-4a61-4dae-a06d-55472c7bdf21") : object "kube-system"/"original-pull-secret" not registered Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-netd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668873 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-netd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-script-lib\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8950ff39-1eba-4849-a3fe-b351b2022c0e-hosts-file\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668898 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.668910 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-cnibin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668934 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8950ff39-1eba-4849-a3fe-b351b2022c0e-hosts-file\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pvrf\" (UniqueName: \"kubernetes.io/projected/1080d3e1-b834-48f5-b2aa-28e01af0bff5-kube-api-access-2pvrf\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.668980 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-cnibin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669024 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-iptables-alerter-script\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669038 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-modprobe-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wqvn\" (UniqueName: \"kubernetes.io/projected/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kube-api-access-8wqvn\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669089 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-netns\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669097 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669114 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-socket-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-multus\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-kubelet\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669167 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-multus-daemon-config\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669178 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-bin\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.669547 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669159 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-netns\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669203 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-config\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669222 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-modprobe-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-multus\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669279 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-systemd\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669281 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-kubelet\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669307 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-lib-modules\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669335 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-bin\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669344 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-systemd\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669354 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-socket-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669403 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqkn\" (UniqueName: \"kubernetes.io/projected/a4f4c9d8-be23-48ea-a760-403fad2fa67b-kube-api-access-gfqkn\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669431 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f700ff69-3257-4068-8eb2-807a7b9f150b-agent-certs\") pod \"konnectivity-agent-c55hv\" (UID: \"f700ff69-3257-4068-8eb2-807a7b9f150b\") " pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-ovn\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysconfig\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669482 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-ovn\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.670322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669454 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-lib-modules\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669524 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysconfig\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669575 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-var-lib-kubelet\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669613 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-multus-certs\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669623 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-iptables-alerter-script\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669646 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-systemd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669629 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-systemd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669684 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-var-lib-kubelet\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-env-overrides\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669709 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669718 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-multus-certs\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjdw8\" (UniqueName: \"kubernetes.io/projected/19603f03-3a29-404a-945e-7c489370a778-kube-api-access-gjdw8\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cnibin\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-host-slash\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-tuned\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669825 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cnibin\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.671178 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669858 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-sys-fs\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669862 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-host-slash\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-hostroot\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669918 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-kubelet\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669941 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-sys-fs\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-run\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-host\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669993 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwzh7\" (UniqueName: \"kubernetes.io/projected/07394429-d52a-4e4f-bf9d-9b33be514f87-kube-api-access-nwzh7\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.669999 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-run\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670027 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a7f110b-9d5e-43a1-832e-0066909fcb5e-serviceca\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670054 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670065 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-env-overrides\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670107 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-device-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670100 2572 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670142 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670153 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-kubelet\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670167 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-systemd-units\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670187 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.672133 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-conf\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670201 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-hostroot\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670258 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-host\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670302 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-systemd-units\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670309 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-device-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670264 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670322 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-conf\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670344 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a7f110b-9d5e-43a1-832e-0066909fcb5e-host\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670364 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-system-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670378 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-etc-kubernetes\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670396 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670391 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-config\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670435 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-etc-kubernetes\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670439 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670439 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a7f110b-9d5e-43a1-832e-0066909fcb5e-host\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-log-socket\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670468 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-system-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-system-cni-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.672911 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670502 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-log-socket\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfkqc\" (UniqueName: \"kubernetes.io/projected/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-kube-api-access-cfkqc\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670526 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-system-cni-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqkzc\" (UniqueName: \"kubernetes.io/projected/8a7f110b-9d5e-43a1-832e-0066909fcb5e-kube-api-access-rqkzc\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670585 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a7f110b-9d5e-43a1-832e-0066909fcb5e-serviceca\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670600 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-slash\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670634 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-slash\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670667 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-kubernetes\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7455j\" (UniqueName: \"kubernetes.io/projected/7780d59b-2c7e-4662-89c8-4414580ee652-kube-api-access-7455j\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.670702 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.670749 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs podName:19603f03-3a29-404a-945e-7c489370a778 nodeName:}" failed. No retries permitted until 2026-11-04 01:33:58.170731452 +0000 UTC m=+2.277031087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs") pod "network-metrics-daemon-2kbxl" (UID: "19603f03-3a29-404a-945e-7c489370a778") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670768 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8950ff39-1eba-4849-a3fe-b351b2022c0e-tmp-dir\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670788 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-kubernetes\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670803 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-tmp\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.673705 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.670989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-node-log\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671025 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovn-node-metrics-cert\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671034 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxb82\" (UniqueName: \"kubernetes.io/projected/8950ff39-1eba-4849-a3fe-b351b2022c0e-kube-api-access-hxb82\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671092 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8950ff39-1eba-4849-a3fe-b351b2022c0e-tmp-dir\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-kubelet-config\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671111 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-node-log\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671116 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-sys\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f700ff69-3257-4068-8eb2-807a7b9f150b-konnectivity-ca\") pod \"konnectivity-agent-c55hv\" (UID: \"f700ff69-3257-4068-8eb2-807a7b9f150b\") " pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671183 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-etc-selinux\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671194 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-kubelet-config\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671207 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-k8s-cni-cncf-io\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671264 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-k8s-cni-cncf-io\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671332 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-etc-selinux\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671332 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-sys\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671377 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-conf-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.674201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-etc-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.674744 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671428 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-cni-binary-copy\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.674744 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-socket-dir-parent\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.674744 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671525 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-socket-dir-parent\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.674744 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671566 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-conf-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.674744 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.671571 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-etc-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.674744 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.672499 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f700ff69-3257-4068-8eb2-807a7b9f150b-konnectivity-ca\") pod \"konnectivity-agent-c55hv\" (UID: \"f700ff69-3257-4068-8eb2-807a7b9f150b\") " pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:33:57.674744 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.672521 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.674744 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.672577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-cni-binary-copy\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.679739 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.679721 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-tuned\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.679779 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.679742 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-tmp\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.679807 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.679779 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovn-node-metrics-cert\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.679909 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.679895 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f700ff69-3257-4068-8eb2-807a7b9f150b-agent-certs\") pod \"konnectivity-agent-c55hv\" (UID: \"f700ff69-3257-4068-8eb2-807a7b9f150b\") " pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:33:57.709927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.709899 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zbbgd\"" Nov 04 01:33:57.709927 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.709917 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 01:33:57.710106 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.709901 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vr5s4\"" Nov 04 01:33:57.710106 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.709901 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tfqdd\"" Nov 04 01:33:57.710106 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.709971 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-sj5vk\"" Nov 04 01:33:57.710106 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.710006 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 01:33:57.719556 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.719514 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-script-lib\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.729002 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.728985 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 01:33:57.729127 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.729012 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 01:33:57.729127 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.729025 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hhtdj for pod openshift-network-diagnostics/network-check-target-nwps2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:33:57.729127 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:57.729098 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj podName:498926f5-18e3-4d4a-8c0c-51d889256af4 nodeName:}" failed. No retries permitted until 2026-11-04 01:33:58.22906582 +0000 UTC m=+2.335365477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hhtdj" (UniqueName: "kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj") pod "network-check-target-nwps2" (UID: "498926f5-18e3-4d4a-8c0c-51d889256af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:33:57.732166 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.732140 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqkn\" (UniqueName: \"kubernetes.io/projected/a4f4c9d8-be23-48ea-a760-403fad2fa67b-kube-api-access-gfqkn\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.732463 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.732415 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjdw8\" (UniqueName: \"kubernetes.io/projected/19603f03-3a29-404a-945e-7c489370a778-kube-api-access-gjdw8\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:33:57.732535 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.732427 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfkqc\" (UniqueName: \"kubernetes.io/projected/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-kube-api-access-cfkqc\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.732627 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.732608 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7455j\" (UniqueName: \"kubernetes.io/projected/7780d59b-2c7e-4662-89c8-4414580ee652-kube-api-access-7455j\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.732687 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.732667 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wqvn\" (UniqueName: \"kubernetes.io/projected/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kube-api-access-8wqvn\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.732914 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.732894 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pvrf\" (UniqueName: \"kubernetes.io/projected/1080d3e1-b834-48f5-b2aa-28e01af0bff5-kube-api-access-2pvrf\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.733504 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.733483 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqkzc\" (UniqueName: \"kubernetes.io/projected/8a7f110b-9d5e-43a1-832e-0066909fcb5e-kube-api-access-rqkzc\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.733600 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.733585 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwzh7\" (UniqueName: \"kubernetes.io/projected/07394429-d52a-4e4f-bf9d-9b33be514f87-kube-api-access-nwzh7\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.734303 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.734284 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxb82\" (UniqueName: \"kubernetes.io/projected/8950ff39-1eba-4849-a3fe-b351b2022c0e-kube-api-access-hxb82\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.833286 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.833250 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:33:57.869847 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.869804 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:33:57.871931 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.871903 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:33:57.886443 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.886423 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:33:57.898331 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.898305 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:33:57.911650 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.911631 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:33:57.933279 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.933255 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:33:57.943622 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:57.943596 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d6b8a5b75c98b7e9c979c9bafacea9.slice/crio-b887b9e7479eb1fb631874ef40e2adc7fbcb62c842e8ad6140166fbc271b8c53 WatchSource:0}: Error finding container b887b9e7479eb1fb631874ef40e2adc7fbcb62c842e8ad6140166fbc271b8c53: Status 404 returned error can't find the container with id b887b9e7479eb1fb631874ef40e2adc7fbcb62c842e8ad6140166fbc271b8c53 Nov 04 01:33:57.944027 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:57.944006 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf700ff69_3257_4068_8eb2_807a7b9f150b.slice/crio-392da7767d47a216a91d6c6d8f07839eadb86247e82c34b1b4531e09c65328e9 WatchSource:0}: Error finding container 392da7767d47a216a91d6c6d8f07839eadb86247e82c34b1b4531e09c65328e9: Status 404 returned error can't find the container with id 392da7767d47a216a91d6c6d8f07839eadb86247e82c34b1b4531e09c65328e9 Nov 04 01:33:57.944575 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:57.944561 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c930d57aa7cd78fff74c7c1e987922.slice/crio-b3668f558975076724138b078984c76886cfab99215c8c1ef767318aaee145d1 WatchSource:0}: Error finding container b3668f558975076724138b078984c76886cfab99215c8c1ef767318aaee145d1: Status 404 returned error can't find the container with id b3668f558975076724138b078984c76886cfab99215c8c1ef767318aaee145d1 Nov 04 01:33:57.948019 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.947998 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9nnr8" Nov 04 01:33:57.948132 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:57.948114 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542f0dbb_ab95_4719_bcf2_6b0441d0feea.slice/crio-35fa75652d6ebe1c9daacc932fd1d55acf245056c8f3e09faf84653a0e464d67 WatchSource:0}: Error finding container 35fa75652d6ebe1c9daacc932fd1d55acf245056c8f3e09faf84653a0e464d67: Status 404 returned error can't find the container with id 35fa75652d6ebe1c9daacc932fd1d55acf245056c8f3e09faf84653a0e464d67 Nov 04 01:33:57.949678 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.949666 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 01:33:57.957213 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:57.957191 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7780d59b_2c7e_4662_89c8_4414580ee652.slice/crio-7890e45aa0a903c13b3e78e544cd9f4b48fdf38a52d214154379654bb9323466 WatchSource:0}: Error finding container 7890e45aa0a903c13b3e78e544cd9f4b48fdf38a52d214154379654bb9323466: Status 404 returned error can't find the container with id 7890e45aa0a903c13b3e78e544cd9f4b48fdf38a52d214154379654bb9323466 Nov 04 01:33:57.964941 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:57.964924 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:33:57.973540 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:33:57.973517 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f4c9d8_be23_48ea_a760_403fad2fa67b.slice/crio-78f30fc12ec012914109eefbc3ff29f7036bdb595750aa4820c54cf4df5f8923 WatchSource:0}: Error finding container 78f30fc12ec012914109eefbc3ff29f7036bdb595750aa4820c54cf4df5f8923: Status 404 returned error can't find the container with id 78f30fc12ec012914109eefbc3ff29f7036bdb595750aa4820c54cf4df5f8923 Nov 04 01:33:58.175346 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:58.175317 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:33:58.175518 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:33:58.175356 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:33:58.175518 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:58.175455 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 01:33:58.175518 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:58.175456 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:33:58.175518 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:58.175505 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret podName:a265f44c-4a61-4dae-a06d-55472c7bdf21 nodeName:}" failed. No retries permitted until 2026-11-04 01:33:59.175493361 +0000 UTC m=+3.281792983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret") pod "global-pull-secret-syncer-rghpj" (UID: "a265f44c-4a61-4dae-a06d-55472c7bdf21") : object "kube-system"/"original-pull-secret" not registered Nov 04 01:33:58.175518 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:33:58.175519 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs podName:19603f03-3a29-404a-945e-7c489370a778 nodeName:}" failed. No retries permitted until 2026-11-04 01:33:59.175511749 +0000 UTC m=+3.281811370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs") pod "network-metrics-daemon-2kbxl" (UID: "19603f03-3a29-404a-945e-7c489370a778") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:00.176165 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.176056 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:00.176938 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:00.176177 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 01:34:00.176938 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:00.176191 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 01:34:00.176938 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:00.176199 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hhtdj for pod openshift-network-diagnostics/network-check-target-nwps2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:00.176938 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:00.176246 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj podName:498926f5-18e3-4d4a-8c0c-51d889256af4 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:01.176234056 +0000 UTC m=+3.382826227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhtdj" (UniqueName: "kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj") pod "network-check-target-nwps2" (UID: "498926f5-18e3-4d4a-8c0c-51d889256af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:00.195554 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.195524 2572 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:34:00.246659 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.246602 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9nnr8" event={"ID":"7780d59b-2c7e-4662-89c8-4414580ee652","Type":"ContainerStarted","Data":"7890e45aa0a903c13b3e78e544cd9f4b48fdf38a52d214154379654bb9323466"} Nov 04 01:34:00.247684 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.247648 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" event={"ID":"542f0dbb-ab95-4719-bcf2-6b0441d0feea","Type":"ContainerStarted","Data":"35fa75652d6ebe1c9daacc932fd1d55acf245056c8f3e09faf84653a0e464d67"} Nov 04 01:34:00.248722 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.248699 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" event={"ID":"c9d6b8a5b75c98b7e9c979c9bafacea9","Type":"ContainerStarted","Data":"b887b9e7479eb1fb631874ef40e2adc7fbcb62c842e8ad6140166fbc271b8c53"} Nov 04 01:34:00.249716 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.249693 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" event={"ID":"23c930d57aa7cd78fff74c7c1e987922","Type":"ContainerStarted","Data":"b3668f558975076724138b078984c76886cfab99215c8c1ef767318aaee145d1"} Nov 04 01:34:00.250797 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.250766 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c55hv" event={"ID":"f700ff69-3257-4068-8eb2-807a7b9f150b","Type":"ContainerStarted","Data":"392da7767d47a216a91d6c6d8f07839eadb86247e82c34b1b4531e09c65328e9"} Nov 04 01:34:00.251743 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.251726 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" event={"ID":"a4f4c9d8-be23-48ea-a760-403fad2fa67b","Type":"ContainerStarted","Data":"78f30fc12ec012914109eefbc3ff29f7036bdb595750aa4820c54cf4df5f8923"} Nov 04 01:34:00.458527 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.458453 2572 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:34:00.542757 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:34:00.542730 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc74bb7_9393_4f6a_b2d1_da324ea4f736.slice/crio-19ca73d86de82b55f012fb3008c71a49c2b5b1082f26573ae4c897069446c66a WatchSource:0}: Error finding container 19ca73d86de82b55f012fb3008c71a49c2b5b1082f26573ae4c897069446c66a: Status 404 returned error can't find the container with id 19ca73d86de82b55f012fb3008c71a49c2b5b1082f26573ae4c897069446c66a Nov 04 01:34:00.556860 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.556813 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 01:28:59 +0000 UTC" deadline="2028-07-17 14:02:29.062800876 +0000 UTC" Nov 04 01:34:00.556860 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.556857 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14916h28m28.505946002s" Nov 04 01:34:00.590612 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:34:00.590587 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7f110b_9d5e_43a1_832e_0066909fcb5e.slice/crio-fd86efd06ac4cd0192bb6bd60c931e398c24f0947aa7de4090e039379221f869 WatchSource:0}: Error finding container fd86efd06ac4cd0192bb6bd60c931e398c24f0947aa7de4090e039379221f869: Status 404 returned error can't find the container with id fd86efd06ac4cd0192bb6bd60c931e398c24f0947aa7de4090e039379221f869 Nov 04 01:34:00.591623 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:34:00.591598 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07394429_d52a_4e4f_bf9d_9b33be514f87.slice/crio-258e2e0bcb56b9c57eba5cd458bea6a6ea33b3f450d4647e8228a5e8edbf5d6a WatchSource:0}: Error finding container 258e2e0bcb56b9c57eba5cd458bea6a6ea33b3f450d4647e8228a5e8edbf5d6a: Status 404 returned error can't find the container with id 258e2e0bcb56b9c57eba5cd458bea6a6ea33b3f450d4647e8228a5e8edbf5d6a Nov 04 01:34:00.625661 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:34:00.625633 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8950ff39_1eba_4849_a3fe_b351b2022c0e.slice/crio-626d88e085ac0160cb44307d5f6371aeafeae814a5517e5e9353633c30fd237a WatchSource:0}: Error finding container 626d88e085ac0160cb44307d5f6371aeafeae814a5517e5e9353633c30fd237a: Status 404 returned error can't find the container with id 626d88e085ac0160cb44307d5f6371aeafeae814a5517e5e9353633c30fd237a Nov 04 01:34:00.637174 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:00.637154 2572 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:34:01.083967 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.083600 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:01.083967 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.083659 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:01.083967 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.083815 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 01:34:01.083967 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.083873 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret podName:a265f44c-4a61-4dae-a06d-55472c7bdf21 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:03.083855175 +0000 UTC m=+5.290447360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret") pod "global-pull-secret-syncer-rghpj" (UID: "a265f44c-4a61-4dae-a06d-55472c7bdf21") : object "kube-system"/"original-pull-secret" not registered Nov 04 01:34:01.084802 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.084714 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:01.084959 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.084925 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs podName:19603f03-3a29-404a-945e-7c489370a778 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:03.084768516 +0000 UTC m=+5.291360704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs") pod "network-metrics-daemon-2kbxl" (UID: "19603f03-3a29-404a-945e-7c489370a778") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:01.184996 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.184683 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:01.184996 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.184856 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 01:34:01.184996 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.184876 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 01:34:01.184996 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.184899 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hhtdj for pod openshift-network-diagnostics/network-check-target-nwps2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:01.184996 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.184957 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj podName:498926f5-18e3-4d4a-8c0c-51d889256af4 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:03.184937947 +0000 UTC m=+5.391530132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhtdj" (UniqueName: "kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj") pod "network-check-target-nwps2" (UID: "498926f5-18e3-4d4a-8c0c-51d889256af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:01.243720 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.243259 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:01.243720 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.243352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:01.243720 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.243473 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:01.243720 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.243545 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:01.243720 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.243614 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:01.243720 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:01.243678 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:01.256446 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.256413 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" event={"ID":"1080d3e1-b834-48f5-b2aa-28e01af0bff5","Type":"ContainerStarted","Data":"c984ff65bb8f97f43bf87f9fbcac89885e299aa841e0b5f7e68c6ca49c5fb2d3"} Nov 04 01:34:01.258085 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.258056 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7dt2n" event={"ID":"8950ff39-1eba-4849-a3fe-b351b2022c0e","Type":"ContainerStarted","Data":"626d88e085ac0160cb44307d5f6371aeafeae814a5517e5e9353633c30fd237a"} Nov 04 01:34:01.259945 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.259913 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h46h5" event={"ID":"07394429-d52a-4e4f-bf9d-9b33be514f87","Type":"ContainerStarted","Data":"258e2e0bcb56b9c57eba5cd458bea6a6ea33b3f450d4647e8228a5e8edbf5d6a"} Nov 04 01:34:01.261756 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.261730 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-klpkr" event={"ID":"8a7f110b-9d5e-43a1-832e-0066909fcb5e","Type":"ContainerStarted","Data":"fd86efd06ac4cd0192bb6bd60c931e398c24f0947aa7de4090e039379221f869"} Nov 04 01:34:01.264419 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.264392 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snwbg" event={"ID":"bdc74bb7-9393-4f6a-b2d1-da324ea4f736","Type":"ContainerStarted","Data":"19ca73d86de82b55f012fb3008c71a49c2b5b1082f26573ae4c897069446c66a"} Nov 04 01:34:01.558628 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.557679 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 01:28:59 +0000 UTC" deadline="2028-07-22 15:58:08.955751872 +0000 UTC" Nov 04 01:34:01.558628 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:01.557732 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15038h24m7.398023069s" Nov 04 01:34:03.106284 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:03.105936 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:03.106284 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:03.105999 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:03.106284 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.106102 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:03.106284 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.106153 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs podName:19603f03-3a29-404a-945e-7c489370a778 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:07.106139952 +0000 UTC m=+9.312732121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs") pod "network-metrics-daemon-2kbxl" (UID: "19603f03-3a29-404a-945e-7c489370a778") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:03.106284 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.106212 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 01:34:03.106284 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.106236 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret podName:a265f44c-4a61-4dae-a06d-55472c7bdf21 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:07.106229176 +0000 UTC m=+9.312821346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret") pod "global-pull-secret-syncer-rghpj" (UID: "a265f44c-4a61-4dae-a06d-55472c7bdf21") : object "kube-system"/"original-pull-secret" not registered Nov 04 01:34:03.206632 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:03.206589 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:03.206825 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.206766 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 01:34:03.206825 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.206804 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 01:34:03.206955 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.206830 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hhtdj for pod openshift-network-diagnostics/network-check-target-nwps2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:03.206955 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.206892 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj podName:498926f5-18e3-4d4a-8c0c-51d889256af4 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:07.206874165 +0000 UTC m=+9.413466350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhtdj" (UniqueName: "kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj") pod "network-check-target-nwps2" (UID: "498926f5-18e3-4d4a-8c0c-51d889256af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:03.243809 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:03.243758 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:03.243994 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.243895 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:03.243994 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:03.243966 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:03.244116 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.244043 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:03.244116 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:03.244089 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:03.244230 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:03.244196 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:04.285679 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:04.285285 2572 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="81a5e4fab3065380bdf060220996e8c962ec1b3ac0ded0dcaaf65452946c4522" exitCode=0 Nov 04 01:34:04.285679 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:04.285579 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" event={"ID":"a4f4c9d8-be23-48ea-a760-403fad2fa67b","Type":"ContainerDied","Data":"81a5e4fab3065380bdf060220996e8c962ec1b3ac0ded0dcaaf65452946c4522"} Nov 04 01:34:04.291378 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:04.290853 2572 generic.go:356] "Generic (PLEG): container finished" podID="23c930d57aa7cd78fff74c7c1e987922" containerID="69f295c23c7be0f990b6828982885a6e8cd44801a842a322562651e6ea56cab2" exitCode=0 Nov 04 01:34:04.291378 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:04.290890 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" event={"ID":"23c930d57aa7cd78fff74c7c1e987922","Type":"ContainerDied","Data":"69f295c23c7be0f990b6828982885a6e8cd44801a842a322562651e6ea56cab2"} Nov 04 01:34:05.243454 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:05.243422 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:05.243644 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:05.243560 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:05.243765 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:05.243647 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:05.243765 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:05.243738 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:05.243891 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:05.243819 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:05.243944 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:05.243889 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:05.296623 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:05.296585 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" event={"ID":"c9d6b8a5b75c98b7e9c979c9bafacea9","Type":"ContainerStarted","Data":"0df092ae4659e96a32f29000fbbf91fd9acf317f769657a87a85f1bc221d0b9d"} Nov 04 01:34:05.301468 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:05.301012 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" event={"ID":"23c930d57aa7cd78fff74c7c1e987922","Type":"ContainerStarted","Data":"287e9f0bea3e1c1b865d1f53bd3c862fc4d5a3799526a5fde7a09950b5313dd0"} Nov 04 01:34:05.305812 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:05.305624 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c55hv" event={"ID":"f700ff69-3257-4068-8eb2-807a7b9f150b","Type":"ContainerStarted","Data":"eb5c61d5c209bdd5cd05632d5ff0f8e76eff63299a42a36b5d52779e8f5189ac"} Nov 04 01:34:05.528935 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:05.528872 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" podStartSLOduration=7.528851577 podStartE2EDuration="7.528851577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:05.41246759 +0000 UTC m=+7.619059787" watchObservedRunningTime="2026-11-04 01:34:05.528851577 +0000 UTC m=+7.735443771" Nov 04 01:34:05.646501 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:05.646439 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" podStartSLOduration=7.646419309 podStartE2EDuration="7.646419309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:05.529574844 +0000 UTC m=+7.736167040" watchObservedRunningTime="2026-11-04 01:34:05.646419309 +0000 UTC m=+7.853011515" Nov 04 01:34:06.317034 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:06.316998 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" event={"ID":"542f0dbb-ab95-4719-bcf2-6b0441d0feea","Type":"ContainerStarted","Data":"ceb2c3d325573f8c3f019099b2abaaf56b3603a34d7f7b5bb6c28b6d3e6152ab"} Nov 04 01:34:07.141738 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:07.141652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:07.141738 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:07.141717 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:07.141977 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.141809 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:07.141977 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.141860 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 01:34:07.141977 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.141882 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs podName:19603f03-3a29-404a-945e-7c489370a778 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:15.141860765 +0000 UTC m=+17.348452950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs") pod "network-metrics-daemon-2kbxl" (UID: "19603f03-3a29-404a-945e-7c489370a778") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:07.141977 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.141909 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret podName:a265f44c-4a61-4dae-a06d-55472c7bdf21 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:15.141893209 +0000 UTC m=+17.348485393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret") pod "global-pull-secret-syncer-rghpj" (UID: "a265f44c-4a61-4dae-a06d-55472c7bdf21") : object "kube-system"/"original-pull-secret" not registered Nov 04 01:34:07.242307 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:07.242265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:07.242533 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.242490 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 01:34:07.242533 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.242512 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 01:34:07.242533 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.242526 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hhtdj for pod openshift-network-diagnostics/network-check-target-nwps2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:07.242723 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.242586 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj podName:498926f5-18e3-4d4a-8c0c-51d889256af4 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:15.242567136 +0000 UTC m=+17.449159330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhtdj" (UniqueName: "kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj") pod "network-check-target-nwps2" (UID: "498926f5-18e3-4d4a-8c0c-51d889256af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:07.245005 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:07.244980 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:07.245447 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.245128 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:07.245447 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:07.245201 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:07.245447 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.245282 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:07.245447 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:07.245316 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:07.245447 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:07.245369 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:07.323144 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:07.323105 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-klpkr" event={"ID":"8a7f110b-9d5e-43a1-832e-0066909fcb5e","Type":"ContainerStarted","Data":"52c27e14d9312d8f7de29757de87f1f018bcc49953de913a1de0f46357eedb91"} Nov 04 01:34:07.442844 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:07.442675 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c55hv" podStartSLOduration=5.0270811 podStartE2EDuration="9.442653918s" totalImagesPullingTime="4.415572818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:05.646959718 +0000 UTC m=+7.853551911" watchObservedRunningTime="2026-11-04 01:34:07.442653918 +0000 UTC m=+9.649246110" Nov 04 01:34:08.298825 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:08.298736 2572 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 01:34:08.327698 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:08.327589 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" event={"ID":"542f0dbb-ab95-4719-bcf2-6b0441d0feea","Type":"ContainerStarted","Data":"ae27c0fd948599c1670a1d307dab69e4da64e8d9f42790fe1f5f21b7506a4dfa"} Nov 04 01:34:08.331760 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:08.331684 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9nnr8" event={"ID":"7780d59b-2c7e-4662-89c8-4414580ee652","Type":"ContainerStarted","Data":"3c1b54b80a02ede53ada4a7b9afe7b6fde0a311384efee7452ca999d6ca85938"} Nov 04 01:34:08.450886 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:08.450819 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-klpkr" podStartSLOduration=4.704805222 podStartE2EDuration="10.450772661s" totalImagesPullingTime="5.745967439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:07.443440726 +0000 UTC m=+9.650032921" watchObservedRunningTime="2026-11-04 01:34:08.450772661 +0000 UTC m=+10.657364854" Nov 04 01:34:08.470548 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:08.470471 2572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:34:08.471428 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:08.471384 2572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:34:08.588603 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:08.588540 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-9nnr8" podStartSLOduration=2.555737181 podStartE2EDuration="10.588518553s" totalImagesPullingTime="8.032781372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:08.451978157 +0000 UTC m=+10.658570350" watchObservedRunningTime="2026-11-04 01:34:08.588518553 +0000 UTC m=+10.795110749" Nov 04 01:34:09.244128 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:09.243541 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:09.244128 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:09.243867 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:09.244128 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:09.243562 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:09.244128 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:09.243951 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:09.244128 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:09.243552 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:09.244128 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:09.244053 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:09.252613 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:09.252494 2572 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T01:34:08.298755103Z","UUID":"a92f509f-f13c-4fd9-a1f1-9b4964b47057","Handler":null,"Name":"","Endpoint":""} Nov 04 01:34:09.254954 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:09.254935 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 01:34:09.255057 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:09.254964 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 01:34:09.335556 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:09.335524 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7dt2n" event={"ID":"8950ff39-1eba-4849-a3fe-b351b2022c0e","Type":"ContainerStarted","Data":"507e6b6ff8c7b9ccb6bf2e4488b8d9175c5c7ceab33613453fa77618d7972782"} Nov 04 01:34:09.339074 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:09.339048 2572 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="afe45968d881bf745badb39022fbfd0d5490c35d7c52569c56039e9235766464" exitCode=0 Nov 04 01:34:09.339218 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:09.339160 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" event={"ID":"a4f4c9d8-be23-48ea-a760-403fad2fa67b","Type":"ContainerDied","Data":"afe45968d881bf745badb39022fbfd0d5490c35d7c52569c56039e9235766464"} Nov 04 01:34:09.452805 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:09.452743 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-7dt2n" podStartSLOduration=3.079059671 podStartE2EDuration="11.452730422s" totalImagesPullingTime="8.373670751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:09.452283295 +0000 UTC m=+11.658875488" watchObservedRunningTime="2026-11-04 01:34:09.452730422 +0000 UTC m=+11.659322613" Nov 04 01:34:10.344737 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:10.344694 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" event={"ID":"542f0dbb-ab95-4719-bcf2-6b0441d0feea","Type":"ContainerStarted","Data":"b61d7b92e8a1ac5ba21ca51d74d9bacda25119f399101cc9022ee587a77b52ee"} Nov 04 01:34:11.243532 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:11.243503 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:11.243706 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:11.243538 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:11.243706 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:11.243669 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:11.243853 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:11.243726 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:11.243853 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:11.243743 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:11.243943 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:11.243869 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:11.348427 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:11.348391 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h46h5" event={"ID":"07394429-d52a-4e4f-bf9d-9b33be514f87","Type":"ContainerStarted","Data":"874e2d01f207cd5c6020a076d6f4a0271c2ed9883e79673107ce886479927d7e"} Nov 04 01:34:11.350333 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:11.350302 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snwbg" event={"ID":"bdc74bb7-9393-4f6a-b2d1-da324ea4f736","Type":"ContainerStarted","Data":"7414464a54925b442006fac7441214771f1e473a47e2dc889f314b223d7a6ea6"} Nov 04 01:34:11.352628 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:11.352600 2572 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="4416f54724a598e722cfccd240a557c85c6949c38ec374eac7b017118a27765b" exitCode=0 Nov 04 01:34:11.352738 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:11.352683 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" event={"ID":"a4f4c9d8-be23-48ea-a760-403fad2fa67b","Type":"ContainerDied","Data":"4416f54724a598e722cfccd240a557c85c6949c38ec374eac7b017118a27765b"} Nov 04 01:34:11.467322 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:11.467275 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h46h5" podStartSLOduration=2.95795908 podStartE2EDuration="13.467260177s" totalImagesPullingTime="10.509301097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:11.467066914 +0000 UTC m=+13.673659108" watchObservedRunningTime="2026-11-04 01:34:11.467260177 +0000 UTC m=+13.673852368" Nov 04 01:34:11.467552 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:11.467534 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" podStartSLOduration=4.142686962 podStartE2EDuration="13.467528406s" totalImagesPullingTime="9.324841444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:10.466013758 +0000 UTC m=+12.672605943" watchObservedRunningTime="2026-11-04 01:34:11.467528406 +0000 UTC m=+13.674120598" Nov 04 01:34:11.705587 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:11.705500 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-snwbg" podStartSLOduration=5.359333663 podStartE2EDuration="13.705483619s" totalImagesPullingTime="8.346149956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:11.705153864 +0000 UTC m=+13.911746056" watchObservedRunningTime="2026-11-04 01:34:11.705483619 +0000 UTC m=+13.912075812" Nov 04 01:34:13.243671 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:13.243640 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:13.244413 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:13.243681 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:13.244413 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:13.243640 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:13.244413 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:13.243766 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:13.244413 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:13.243851 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:13.244413 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:13.243922 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:13.360955 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:13.360919 2572 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="9511d461023fd146111b8b8165a99b7dc9308b3c58ffa1bf0860467d2876a743" exitCode=0 Nov 04 01:34:13.361131 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:13.360984 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" event={"ID":"a4f4c9d8-be23-48ea-a760-403fad2fa67b","Type":"ContainerDied","Data":"9511d461023fd146111b8b8165a99b7dc9308b3c58ffa1bf0860467d2876a743"} Nov 04 01:34:15.205731 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.205528 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:15.206227 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.205764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:15.206227 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.205670 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:15.206227 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.205900 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs podName:19603f03-3a29-404a-945e-7c489370a778 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:31.205877684 +0000 UTC m=+33.412469871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs") pod "network-metrics-daemon-2kbxl" (UID: "19603f03-3a29-404a-945e-7c489370a778") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:15.206227 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.205904 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 01:34:15.206227 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.205958 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret podName:a265f44c-4a61-4dae-a06d-55472c7bdf21 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:31.205945278 +0000 UTC m=+33.412537449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret") pod "global-pull-secret-syncer-rghpj" (UID: "a265f44c-4a61-4dae-a06d-55472c7bdf21") : object "kube-system"/"original-pull-secret" not registered Nov 04 01:34:15.243296 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.243268 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:15.243408 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.243329 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:15.243460 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.243432 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:15.243460 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.243431 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:15.243533 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.243519 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:15.243650 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.243624 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:15.306743 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.306545 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:15.306862 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.306694 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 01:34:15.306862 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.306841 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 01:34:15.306862 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.306860 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hhtdj for pod openshift-network-diagnostics/network-check-target-nwps2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:15.307116 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:15.306929 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj podName:498926f5-18e3-4d4a-8c0c-51d889256af4 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:31.306907739 +0000 UTC m=+33.513499912 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhtdj" (UniqueName: "kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj") pod "network-check-target-nwps2" (UID: "498926f5-18e3-4d4a-8c0c-51d889256af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:15.370886 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.370775 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" event={"ID":"a4f4c9d8-be23-48ea-a760-403fad2fa67b","Type":"ContainerStarted","Data":"af5bc25f281bfdd3df8417c364299780ea8d54dffbcc822131a472b661978dae"} Nov 04 01:34:15.374006 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.373978 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" event={"ID":"1080d3e1-b834-48f5-b2aa-28e01af0bff5","Type":"ContainerStarted","Data":"94ef5df96f80ec23ea8c3d7e352f8b86ab864497962394c1792d581c645faeb2"} Nov 04 01:34:15.374102 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.374042 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" event={"ID":"1080d3e1-b834-48f5-b2aa-28e01af0bff5","Type":"ContainerStarted","Data":"c3dce495d8b393f4d55f406129b5cdc82d91f8695e9655b60b255219f76b9e73"} Nov 04 01:34:15.374102 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.374073 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" event={"ID":"1080d3e1-b834-48f5-b2aa-28e01af0bff5","Type":"ContainerStarted","Data":"36935b4677fe355b576f26bbebfa9188547494630bf4b6cda926c140cc4a13c8"} Nov 04 01:34:15.374102 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:15.374099 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" event={"ID":"1080d3e1-b834-48f5-b2aa-28e01af0bff5","Type":"ContainerStarted","Data":"5b22b1d2eb57f75700ac8177a37e3cba2774849dc2ed248cbeb3b183e3c12357"} Nov 04 01:34:16.378502 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:16.378460 2572 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="af5bc25f281bfdd3df8417c364299780ea8d54dffbcc822131a472b661978dae" exitCode=0 Nov 04 01:34:16.379056 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:16.378542 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" event={"ID":"a4f4c9d8-be23-48ea-a760-403fad2fa67b","Type":"ContainerDied","Data":"af5bc25f281bfdd3df8417c364299780ea8d54dffbcc822131a472b661978dae"} Nov 04 01:34:16.381650 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:16.381623 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" event={"ID":"1080d3e1-b834-48f5-b2aa-28e01af0bff5","Type":"ContainerStarted","Data":"6f72ed3fc6c888eafba8d52b3f575baa483bd24a0c7ea6621f979951296787de"} Nov 04 01:34:16.381720 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:16.381706 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" event={"ID":"1080d3e1-b834-48f5-b2aa-28e01af0bff5","Type":"ContainerStarted","Data":"6beb6a138e65d795ad95553af85463bb093db39a843e9e5f71001848cf196a13"} Nov 04 01:34:17.243881 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:17.243843 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:17.243881 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:17.243876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:17.244134 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:17.243885 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:17.244134 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:17.243947 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:17.244134 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:17.244062 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:17.244248 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:17.244152 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:17.386991 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:17.386952 2572 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="38b036e45aa608c39ecda320ee2431676a365d42f5a9226cc9a5289e39b8776f" exitCode=0 Nov 04 01:34:17.387422 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:17.386992 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" event={"ID":"a4f4c9d8-be23-48ea-a760-403fad2fa67b","Type":"ContainerDied","Data":"38b036e45aa608c39ecda320ee2431676a365d42f5a9226cc9a5289e39b8776f"} Nov 04 01:34:17.721306 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:17.721271 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:34:17.721474 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:17.721394 2572 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 01:34:17.721938 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:17.721915 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:34:18.394123 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:18.394083 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" event={"ID":"a4f4c9d8-be23-48ea-a760-403fad2fa67b","Type":"ContainerStarted","Data":"427eae1864610ca476cd7ab21a2cf434de8b81493cc4b5d3953b158a542538d8"} Nov 04 01:34:18.397177 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:18.397153 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" event={"ID":"1080d3e1-b834-48f5-b2aa-28e01af0bff5","Type":"ContainerStarted","Data":"cda7cfd99d543a79b58b8b2f60b94f86416751121b5ff66b441aef782972da50"} Nov 04 01:34:18.530395 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:18.530345 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g7rmq" podStartSLOduration=9.029241564 podStartE2EDuration="20.530332829s" totalImagesPullingTime="11.501091265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:18.5286334 +0000 UTC m=+20.735225591" watchObservedRunningTime="2026-11-04 01:34:18.530332829 +0000 UTC m=+20.736925021" Nov 04 01:34:19.243903 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:19.243871 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:19.243903 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:19.243901 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:19.244101 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:19.243973 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:19.244101 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:19.244024 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:19.244101 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:19.244089 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:19.244255 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:19.244146 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:20.404389 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:20.404201 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" event={"ID":"1080d3e1-b834-48f5-b2aa-28e01af0bff5","Type":"ContainerStarted","Data":"5aa2623f4fde0391124eae178f17c2670b70f92066917c919ea986824f6b4bb5"} Nov 04 01:34:20.405002 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:20.404430 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:34:20.405002 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:20.404465 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:34:20.420652 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:20.420630 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:34:20.687253 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:20.687162 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" podStartSLOduration=8.24293655 podStartE2EDuration="22.687148989s" totalImagesPullingTime="14.444212439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:20.662229571 +0000 UTC m=+22.868821763" watchObservedRunningTime="2026-11-04 01:34:20.687148989 +0000 UTC m=+22.893741181" Nov 04 01:34:21.243762 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:21.243728 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:21.244011 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:21.243765 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:21.244011 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:21.243877 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:21.244011 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:21.243892 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:21.244011 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:21.243950 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:21.244165 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:21.244029 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:21.406757 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:21.406722 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:34:21.422012 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:21.421985 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:34:22.390293 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:22.390262 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nwps2"] Nov 04 01:34:22.390476 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:22.390373 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:22.390476 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:22.390462 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:22.393740 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:22.393689 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2kbxl"] Nov 04 01:34:22.393877 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:22.393820 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:22.393923 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:22.393906 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:22.394209 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:22.394190 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rghpj"] Nov 04 01:34:22.394274 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:22.394263 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:22.394347 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:22.394331 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:24.243845 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:24.243766 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:24.243845 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:24.243827 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:24.244360 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:24.243912 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:24.244360 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:24.243932 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:24.244360 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:24.244039 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:24.244360 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:24.244208 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:26.243892 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:26.243854 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:26.244388 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:26.243859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:26.244388 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:26.243966 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:26.244388 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:26.244091 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:26.244388 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:26.243869 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:26.244388 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:26.244219 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:28.244188 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:28.244155 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:28.244569 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:28.244276 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:28.244569 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:28.244327 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:28.244569 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:28.244395 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:28.244796 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:28.244742 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:28.244901 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:28.244881 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:28.994628 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:28.994457 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7dt2n_8950ff39-1eba-4849-a3fe-b351b2022c0e/dns-node-resolver/0.log" Nov 04 01:34:29.666412 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:29.666375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c55hv_f700ff69-3257-4068-8eb2-807a7b9f150b/konnectivity-agent/0.log" limit=1024 Nov 04 01:34:29.978994 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:29.978904 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c55hv_f700ff69-3257-4068-8eb2-807a7b9f150b/konnectivity-agent/0.log" limit=1024 Nov 04 01:34:30.017697 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:30.017671 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-klpkr_8a7f110b-9d5e-43a1-832e-0066909fcb5e/node-ca/0.log" Nov 04 01:34:30.243439 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:30.243352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:30.243596 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:30.243365 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:30.243596 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:30.243462 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:30.243596 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:30.243478 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:30.243596 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:30.243577 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:30.243741 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:30.243664 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:30.278537 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:30.278505 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c55hv_f700ff69-3257-4068-8eb2-807a7b9f150b/konnectivity-agent/0.log" limit=1024 Nov 04 01:34:31.224693 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:31.224656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:31.224693 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:31.224697 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:31.225225 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:31.224808 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 01:34:31.225225 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:31.224808 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:31.225225 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:31.224866 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret podName:a265f44c-4a61-4dae-a06d-55472c7bdf21 nodeName:}" failed. No retries permitted until 2026-11-04 01:35:03.224852897 +0000 UTC m=+65.431445068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret") pod "global-pull-secret-syncer-rghpj" (UID: "a265f44c-4a61-4dae-a06d-55472c7bdf21") : object "kube-system"/"original-pull-secret" not registered Nov 04 01:34:31.225225 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:31.224882 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs podName:19603f03-3a29-404a-945e-7c489370a778 nodeName:}" failed. No retries permitted until 2026-11-04 01:35:03.224873997 +0000 UTC m=+65.431466166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs") pod "network-metrics-daemon-2kbxl" (UID: "19603f03-3a29-404a-945e-7c489370a778") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 01:34:31.325031 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:31.324996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:31.325199 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:31.325155 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 01:34:31.325199 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:31.325173 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 01:34:31.325199 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:31.325183 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hhtdj for pod openshift-network-diagnostics/network-check-target-nwps2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:31.325309 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:31.325233 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj podName:498926f5-18e3-4d4a-8c0c-51d889256af4 nodeName:}" failed. No retries permitted until 2026-11-04 01:35:03.32522164 +0000 UTC m=+65.531813826 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhtdj" (UniqueName: "kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj") pod "network-check-target-nwps2" (UID: "498926f5-18e3-4d4a-8c0c-51d889256af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 01:34:32.243913 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:32.243876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:32.243913 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:32.243876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:32.244347 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:32.243987 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:32.244347 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:32.243896 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:32.244347 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:32.244097 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:32.244347 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:32.244173 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:34.243664 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:34.243637 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:34.244110 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:34.243635 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:34.244110 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:34.243735 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:34.244110 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:34.243828 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:34.244110 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:34.243647 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:34.244110 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:34.243907 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:36.243651 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:36.243610 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:36.244103 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:36.243659 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:36.244103 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:36.243617 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:36.244103 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:36.243738 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:36.244103 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:36.243863 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:36.244103 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:36.243945 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:38.244423 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:38.244387 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:38.244957 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:38.244553 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:38.244957 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:38.244570 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:38.244957 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:38.244663 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:38.244957 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:38.244676 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:38.244957 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:38.244740 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:40.243684 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:40.243656 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:40.243684 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:40.243681 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:40.244167 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:40.243708 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:40.244167 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:40.243799 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:40.244167 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:40.243898 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:40.244167 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:40.243985 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:42.245985 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:42.245951 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:42.246462 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:42.246058 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:42.246462 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:42.246064 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:42.246462 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:42.246194 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:42.246462 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:42.246202 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:42.246462 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:42.246293 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:44.243032 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:44.242999 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:44.243032 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:44.243035 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:44.243482 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:44.242999 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:44.243482 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:44.243105 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:44.243482 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:44.243172 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:44.243482 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:44.243253 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:46.243668 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:46.243633 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:46.244048 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:46.243700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:46.244048 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:46.243697 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:46.244048 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:46.243813 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:46.244048 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:46.243867 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:46.244048 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:46.243964 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:48.244794 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:48.244743 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:48.245282 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:48.244859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:48.245282 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:48.244891 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:48.245282 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:48.244904 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:48.245282 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:48.244973 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:48.245282 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:48.245054 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:50.242947 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:50.242902 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:50.243387 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:50.242904 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:50.243387 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:50.243053 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kbxl" podUID="19603f03-3a29-404a-945e-7c489370a778" Nov 04 01:34:50.243387 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:50.243099 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:50.243387 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:50.243216 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rghpj" podUID="a265f44c-4a61-4dae-a06d-55472c7bdf21" Nov 04 01:34:50.243387 ip-10-0-135-4 kubenswrapper[2572]: E1104 01:34:50.243302 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwps2" podUID="498926f5-18e3-4d4a-8c0c-51d889256af4" Nov 04 01:34:51.087558 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.087535 2572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeReady" Nov 04 01:34:51.087725 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.087673 2572 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 04 01:34:51.245890 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.245854 2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4m5nq"] Nov 04 01:34:51.247468 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.247453 2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zcqh2"] Nov 04 01:34:51.247606 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.247587 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.249095 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.249077 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:34:51.267886 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.267859 2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dzv4w"] Nov 04 01:34:51.270880 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.270860 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4m5nq"] Nov 04 01:34:51.270980 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.270899 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zcqh2"] Nov 04 01:34:51.270980 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.270969 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.290659 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.290633 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dzv4w"] Nov 04 01:34:51.302093 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.302072 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 01:34:51.302453 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.302433 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 01:34:51.302554 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.302478 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 01:34:51.302554 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.302544 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkhwh\"" Nov 04 01:34:51.302650 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.302549 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 01:34:51.302650 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.302547 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 01:34:51.317843 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.317823 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gnb5c\"" Nov 04 01:34:51.324852 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.324821 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 01:34:51.324972 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.324854 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j6ln8\"" Nov 04 01:34:51.324972 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.324921 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 01:34:51.325078 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.325011 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 01:34:51.350291 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.350247 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 01:34:51.351480 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-cert\") pod \"ingress-canary-zcqh2\" (UID: \"1a4890fd-1ea5-4b53-9b71-b641ad07ad59\") " pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:34:51.351558 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16dce250-b54a-40e2-a387-527df0330eb3-crio-socket\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.351558 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351524 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16dce250-b54a-40e2-a387-527df0330eb3-data-volume\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.351625 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759c26ae-5372-442b-8752-61cea976fd25-tmp-dir\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.351663 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xqrc\" (UniqueName: \"kubernetes.io/projected/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-kube-api-access-9xqrc\") pod \"ingress-canary-zcqh2\" (UID: \"1a4890fd-1ea5-4b53-9b71-b641ad07ad59\") " pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:34:51.351732 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351716 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/759c26ae-5372-442b-8752-61cea976fd25-config-volume\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.351770 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16dce250-b54a-40e2-a387-527df0330eb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.351821 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5zjf\" (UniqueName: \"kubernetes.io/projected/16dce250-b54a-40e2-a387-527df0330eb3-kube-api-access-q5zjf\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.351881 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/759c26ae-5372-442b-8752-61cea976fd25-metrics-tls\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.351914 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbj46\" (UniqueName: \"kubernetes.io/projected/759c26ae-5372-442b-8752-61cea976fd25-kube-api-access-kbj46\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.351944 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.351931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16dce250-b54a-40e2-a387-527df0330eb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.452756 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.452713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16dce250-b54a-40e2-a387-527df0330eb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.452756 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.452757 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5zjf\" (UniqueName: \"kubernetes.io/projected/16dce250-b54a-40e2-a387-527df0330eb3-kube-api-access-q5zjf\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.453026 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.452809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/759c26ae-5372-442b-8752-61cea976fd25-metrics-tls\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.453026 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.452826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbj46\" (UniqueName: \"kubernetes.io/projected/759c26ae-5372-442b-8752-61cea976fd25-kube-api-access-kbj46\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.453026 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.452846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16dce250-b54a-40e2-a387-527df0330eb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.453026 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.452862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-cert\") pod \"ingress-canary-zcqh2\" (UID: \"1a4890fd-1ea5-4b53-9b71-b641ad07ad59\") " pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:34:51.453026 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.452882 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16dce250-b54a-40e2-a387-527df0330eb3-crio-socket\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.453026 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.452903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16dce250-b54a-40e2-a387-527df0330eb3-data-volume\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.453026 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.452931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759c26ae-5372-442b-8752-61cea976fd25-tmp-dir\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.453026 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.452976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xqrc\" (UniqueName: \"kubernetes.io/projected/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-kube-api-access-9xqrc\") pod \"ingress-canary-zcqh2\" (UID: \"1a4890fd-1ea5-4b53-9b71-b641ad07ad59\") " pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:34:51.453026 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.453009 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/759c26ae-5372-442b-8752-61cea976fd25-config-volume\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.453430 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.453131 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16dce250-b54a-40e2-a387-527df0330eb3-crio-socket\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.453430 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.453361 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16dce250-b54a-40e2-a387-527df0330eb3-data-volume\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.453525 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.453493 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759c26ae-5372-442b-8752-61cea976fd25-tmp-dir\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.453708 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.453689 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/759c26ae-5372-442b-8752-61cea976fd25-config-volume\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.453852 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.453831 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16dce250-b54a-40e2-a387-527df0330eb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.456669 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.456639 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16dce250-b54a-40e2-a387-527df0330eb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.456669 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.456663 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/759c26ae-5372-442b-8752-61cea976fd25-metrics-tls\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.456854 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.456773 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-cert\") pod \"ingress-canary-zcqh2\" (UID: \"1a4890fd-1ea5-4b53-9b71-b641ad07ad59\") " pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:34:51.514945 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.514911 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbj46\" (UniqueName: \"kubernetes.io/projected/759c26ae-5372-442b-8752-61cea976fd25-kube-api-access-kbj46\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.515068 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.515002 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5zjf\" (UniqueName: \"kubernetes.io/projected/16dce250-b54a-40e2-a387-527df0330eb3-kube-api-access-q5zjf\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.515213 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.515193 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xqrc\" (UniqueName: \"kubernetes.io/projected/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-kube-api-access-9xqrc\") pod \"ingress-canary-zcqh2\" (UID: \"1a4890fd-1ea5-4b53-9b71-b641ad07ad59\") " pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:34:51.559642 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.559619 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:51.563677 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.563655 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:34:51.583453 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.583421 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:34:51.942690 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.942670 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zcqh2"] Nov 04 01:34:51.945494 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:34:51.945468 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4890fd_1ea5_4b53_9b71_b641ad07ad59.slice/crio-e110f56948d18b5c9d8ad00b192bbd1b378022d38503d37af65304c72335c9ac WatchSource:0}: Error finding container e110f56948d18b5c9d8ad00b192bbd1b378022d38503d37af65304c72335c9ac: Status 404 returned error can't find the container with id e110f56948d18b5c9d8ad00b192bbd1b378022d38503d37af65304c72335c9ac Nov 04 01:34:51.992900 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.992882 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4m5nq"] Nov 04 01:34:51.996977 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:51.996954 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dzv4w"] Nov 04 01:34:51.999589 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:34:51.999567 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16dce250_b54a_40e2_a387_527df0330eb3.slice/crio-fc287e8cbd33968059145dbcfd79aae31247e76e0ed5c5c6cc3a6de81cd3dd7f WatchSource:0}: Error finding container fc287e8cbd33968059145dbcfd79aae31247e76e0ed5c5c6cc3a6de81cd3dd7f: Status 404 returned error can't find the container with id fc287e8cbd33968059145dbcfd79aae31247e76e0ed5c5c6cc3a6de81cd3dd7f Nov 04 01:34:52.243269 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.243183 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:34:52.243269 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.243204 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:34:52.243519 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.243342 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:34:52.296985 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.296959 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 01:34:52.296985 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.296984 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 01:34:52.297424 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.297174 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 01:34:52.297424 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.297182 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-ldpmc\"" Nov 04 01:34:52.297424 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.297191 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 01:34:52.297424 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.297244 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-vqsf7\"" Nov 04 01:34:52.297424 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.297250 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mh5l6\"" Nov 04 01:34:52.472244 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.472214 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzv4w" event={"ID":"16dce250-b54a-40e2-a387-527df0330eb3","Type":"ContainerStarted","Data":"1ce4b82f0c09e6066fdcb53f8144995f0a2a598ea7a450759b2fd7899f53fbda"} Nov 04 01:34:52.472406 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.472271 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzv4w" event={"ID":"16dce250-b54a-40e2-a387-527df0330eb3","Type":"ContainerStarted","Data":"fc287e8cbd33968059145dbcfd79aae31247e76e0ed5c5c6cc3a6de81cd3dd7f"} Nov 04 01:34:52.473319 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.473290 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zcqh2" event={"ID":"1a4890fd-1ea5-4b53-9b71-b641ad07ad59","Type":"ContainerStarted","Data":"e110f56948d18b5c9d8ad00b192bbd1b378022d38503d37af65304c72335c9ac"} Nov 04 01:34:52.474338 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:52.474315 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4m5nq" event={"ID":"759c26ae-5372-442b-8752-61cea976fd25","Type":"ContainerStarted","Data":"702f2a38bbaab88979cb7e61fbcafe483a7cadf76533527c317a29f7b6105d67"} Nov 04 01:34:53.346355 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:53.346284 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7dt2n_8950ff39-1eba-4849-a3fe-b351b2022c0e/dns-node-resolver/0.log" Nov 04 01:34:53.426426 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:53.426400 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:34:53.479469 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:53.479429 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzv4w" event={"ID":"16dce250-b54a-40e2-a387-527df0330eb3","Type":"ContainerStarted","Data":"f174f413780077ef6679c3d5106c004015566b53c993c818c127d5492a4f5aa9"} Nov 04 01:34:54.486794 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:54.486753 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4m5nq" event={"ID":"759c26ae-5372-442b-8752-61cea976fd25","Type":"ContainerStarted","Data":"64294048e13509d3a3becb89ee311fc1418c5f706ed1684599291a0809b53467"} Nov 04 01:34:54.746247 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:54.746175 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-klpkr_8a7f110b-9d5e-43a1-832e-0066909fcb5e/node-ca/0.log" Nov 04 01:34:54.910464 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:54.910435 2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-56f8696d4d-cjpdx"] Nov 04 01:34:54.913384 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:54.912402 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:54.966326 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:54.966295 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Nov 04 01:34:55.016701 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.016655 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2jjdl\"" Nov 04 01:34:55.016701 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.016672 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Nov 04 01:34:55.016701 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.016655 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Nov 04 01:34:55.016701 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.016664 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Nov 04 01:34:55.016968 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.016668 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 04 01:34:55.016968 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.016660 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Nov 04 01:34:55.016968 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.016747 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 04 01:34:55.017552 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.017534 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f8696d4d-cjpdx"] Nov 04 01:34:55.082171 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.082146 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-service-ca\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.082292 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.082177 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-oauth-serving-cert\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.082292 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.082197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-config\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.082292 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.082232 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-serving-cert\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.082438 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.082337 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-oauth-config\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.082507 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.082483 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3051e1d4-8634-414d-ab3e-6c970a0a5cac-tmp\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.082555 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.082527 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7bvd\" (UniqueName: \"kubernetes.io/projected/3051e1d4-8634-414d-ab3e-6c970a0a5cac-kube-api-access-s7bvd\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.183334 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.183287 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-service-ca\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.183334 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.183323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-oauth-serving-cert\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.183591 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.183349 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-config\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.183591 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.183463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-serving-cert\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.183591 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.183493 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-oauth-config\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.183591 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.183520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3051e1d4-8634-414d-ab3e-6c970a0a5cac-tmp\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.183591 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.183542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7bvd\" (UniqueName: \"kubernetes.io/projected/3051e1d4-8634-414d-ab3e-6c970a0a5cac-kube-api-access-s7bvd\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.184257 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.184164 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-config\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.184257 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.184170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-service-ca\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.184257 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.184198 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3051e1d4-8634-414d-ab3e-6c970a0a5cac-tmp\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.184567 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.184540 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-oauth-serving-cert\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.186151 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.186124 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-oauth-config\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.186236 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.186190 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-serving-cert\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.251132 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.251094 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7bvd\" (UniqueName: \"kubernetes.io/projected/3051e1d4-8634-414d-ab3e-6c970a0a5cac-kube-api-access-s7bvd\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.491332 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.491244 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4m5nq" event={"ID":"759c26ae-5372-442b-8752-61cea976fd25","Type":"ContainerStarted","Data":"49ab1691e28a7acb3cf7ae9332e11674c6cbc69b1595368cfa4617ca00f3cbe0"} Nov 04 01:34:55.491774 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.491430 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4m5nq" Nov 04 01:34:55.493430 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.493406 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzv4w" event={"ID":"16dce250-b54a-40e2-a387-527df0330eb3","Type":"ContainerStarted","Data":"13af3823f6052361a1b1354225be23886df72edb30f9c259268b00877e8e98c1"} Nov 04 01:34:55.494839 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.494805 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zcqh2" event={"ID":"1a4890fd-1ea5-4b53-9b71-b641ad07ad59","Type":"ContainerStarted","Data":"a55c51451b83e6089506ca778723bd59b442d77852ccdc66bdac440b3add1b1b"} Nov 04 01:34:55.525291 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.525262 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:34:55.610876 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.610831 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-4m5nq" podStartSLOduration=2.326879148 podStartE2EDuration="4.610816939s" totalImagesPullingTime="2.283937791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:55.610289374 +0000 UTC m=+57.816881567" watchObservedRunningTime="2026-11-04 01:34:55.610816939 +0000 UTC m=+57.817409130" Nov 04 01:34:55.727445 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.727390 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zcqh2" podStartSLOduration=1.644508391 podStartE2EDuration="4.727376932s" totalImagesPullingTime="3.082868541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:55.726955497 +0000 UTC m=+57.933547686" watchObservedRunningTime="2026-11-04 01:34:55.727376932 +0000 UTC m=+57.933969144" Nov 04 01:34:55.746186 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.746109 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zcqh2_1a4890fd-1ea5-4b53-9b71-b641ad07ad59/serve-healthcheck-canary/0.log" Nov 04 01:34:55.847192 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.847143 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dzv4w" podStartSLOduration=1.9415090720000001 podStartE2EDuration="4.84712808s" totalImagesPullingTime="2.905619008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:34:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:55.846543333 +0000 UTC m=+58.053135526" watchObservedRunningTime="2026-11-04 01:34:55.84712808 +0000 UTC m=+58.053720272" Nov 04 01:34:55.892913 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:55.892890 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f8696d4d-cjpdx"] Nov 04 01:34:55.895180 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:34:55.895153 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3051e1d4_8634_414d_ab3e_6c970a0a5cac.slice/crio-26a5cb0e95819f513da6dae01a1b2b019546b91c299328f616c69863371acbd0 WatchSource:0}: Error finding container 26a5cb0e95819f513da6dae01a1b2b019546b91c299328f616c69863371acbd0: Status 404 returned error can't find the container with id 26a5cb0e95819f513da6dae01a1b2b019546b91c299328f616c69863371acbd0 Nov 04 01:34:56.498268 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:56.498224 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f8696d4d-cjpdx" event={"ID":"3051e1d4-8634-414d-ab3e-6c970a0a5cac","Type":"ContainerStarted","Data":"26a5cb0e95819f513da6dae01a1b2b019546b91c299328f616c69863371acbd0"} Nov 04 01:34:59.506824 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.506771 2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl"] Nov 04 01:34:59.508626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.508605 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.512966 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.512938 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f8696d4d-cjpdx" event={"ID":"3051e1d4-8634-414d-ab3e-6c970a0a5cac","Type":"ContainerStarted","Data":"b9366095cc8336740085101094b5dd6aecc0c959edfa9aba27f7a9886dff7921"} Nov 04 01:34:59.561499 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.561464 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 01:34:59.561682 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.561661 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 01:34:59.562058 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.562038 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 04 01:34:59.562140 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.562097 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 04 01:34:59.562174 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.562141 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 04 01:34:59.562205 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.562192 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gpnv2\"" Nov 04 01:34:59.578729 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.578710 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl"] Nov 04 01:34:59.619757 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.619729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.619757 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.619761 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmws\" (UniqueName: \"kubernetes.io/projected/b98854d2-7827-41a7-b636-5c7a95343ce5-kube-api-access-vcmws\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.619967 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.619815 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.620012 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.619966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98854d2-7827-41a7-b636-5c7a95343ce5-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.634838 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.634812 2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-76zqz"] Nov 04 01:34:59.636539 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.636525 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.701594 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.701567 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 04 01:34:59.721110 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.721082 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.721110 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.721112 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmws\" (UniqueName: \"kubernetes.io/projected/b98854d2-7827-41a7-b636-5c7a95343ce5-kube-api-access-vcmws\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.721275 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.721145 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.721275 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.721176 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98854d2-7827-41a7-b636-5c7a95343ce5-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.721795 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.721761 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98854d2-7827-41a7-b636-5c7a95343ce5-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.723663 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.723644 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.723851 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.723836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.748304 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.748263 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-56f8696d4d-cjpdx" podStartSLOduration=2.661923271 podStartE2EDuration="5.748251732s" totalImagesPullingTime="3.086328461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:59.747792761 +0000 UTC m=+61.954384944" watchObservedRunningTime="2026-11-04 01:34:59.748251732 +0000 UTC m=+61.954843923" Nov 04 01:34:59.770478 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.770414 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bnxvr\"" Nov 04 01:34:59.770478 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.770419 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 04 01:34:59.770478 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.770440 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 04 01:34:59.782921 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.782901 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmws\" (UniqueName: \"kubernetes.io/projected/b98854d2-7827-41a7-b636-5c7a95343ce5-kube-api-access-vcmws\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.820425 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.820399 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:34:59.821720 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.821698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-977vg\" (UniqueName: \"kubernetes.io/projected/0681cec5-c66c-49fc-9694-1dd49f6696e5-kube-api-access-977vg\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.821773 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.821754 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.821902 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.821880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-metrics-client-ca\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.821953 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.821937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-sys\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.821986 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.821973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-root\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.822046 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.822028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-wtmp\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.822092 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.822059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.822139 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.822100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-textfile\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.822195 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.822176 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-tls\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.922934 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.922901 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-textfile\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.922934 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.922949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-tls\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923161 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.922968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-977vg\" (UniqueName: \"kubernetes.io/projected/0681cec5-c66c-49fc-9694-1dd49f6696e5-kube-api-access-977vg\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923161 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923001 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923161 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-metrics-client-ca\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923161 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-sys\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923161 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-root\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923161 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-wtmp\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923161 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923487 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923165 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-sys\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923487 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923230 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-root\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923487 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923326 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-textfile\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923487 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923354 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-wtmp\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923696 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923676 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.923738 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.923687 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-metrics-client-ca\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.925438 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.925414 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.925539 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.925523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-tls\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:34:59.984531 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:34:59.984498 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-977vg\" (UniqueName: \"kubernetes.io/projected/0681cec5-c66c-49fc-9694-1dd49f6696e5-kube-api-access-977vg\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:00.247116 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:00.247083 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl"] Nov 04 01:35:00.247228 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:00.247207 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:00.247628 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:35:00.247609 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98854d2_7827_41a7_b636_5c7a95343ce5.slice/crio-41eb00308cef99316727394b04c9ad05d1d72370cd39a3688e18c6a2003a708b WatchSource:0}: Error finding container 41eb00308cef99316727394b04c9ad05d1d72370cd39a3688e18c6a2003a708b: Status 404 returned error can't find the container with id 41eb00308cef99316727394b04c9ad05d1d72370cd39a3688e18c6a2003a708b Nov 04 01:35:00.258151 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:35:00.258126 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0681cec5_c66c_49fc_9694_1dd49f6696e5.slice/crio-0417884e5936d24966ea3c9cd23534419703d2b485609309fae6d36cecb223d5 WatchSource:0}: Error finding container 0417884e5936d24966ea3c9cd23534419703d2b485609309fae6d36cecb223d5: Status 404 returned error can't find the container with id 0417884e5936d24966ea3c9cd23534419703d2b485609309fae6d36cecb223d5 Nov 04 01:35:00.517040 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:00.516997 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76zqz" event={"ID":"0681cec5-c66c-49fc-9694-1dd49f6696e5","Type":"ContainerStarted","Data":"0417884e5936d24966ea3c9cd23534419703d2b485609309fae6d36cecb223d5"} Nov 04 01:35:00.518856 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:00.518828 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" event={"ID":"b98854d2-7827-41a7-b636-5c7a95343ce5","Type":"ContainerStarted","Data":"c5d6b05b88a88803a003efd332cec1d8f4779d981a9437e21b1cfbd38ecd84e2"} Nov 04 01:35:00.518961 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:00.518885 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" event={"ID":"b98854d2-7827-41a7-b636-5c7a95343ce5","Type":"ContainerStarted","Data":"fb87bb7f1d8f1ad0d54f1cd01d931f7b4a97943102b489c8818b15ec6adea494"} Nov 04 01:35:00.518961 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:00.518915 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" event={"ID":"b98854d2-7827-41a7-b636-5c7a95343ce5","Type":"ContainerStarted","Data":"41eb00308cef99316727394b04c9ad05d1d72370cd39a3688e18c6a2003a708b"} Nov 04 01:35:01.858175 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:01.858143 2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 01:35:01.860359 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:01.860342 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.016937 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.016901 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 04 01:35:02.016937 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.016905 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 04 01:35:02.017220 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.016942 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 04 01:35:02.017220 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.016975 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 04 01:35:02.017220 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.016976 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 04 01:35:02.017220 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.017011 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 04 01:35:02.017220 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.017024 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 04 01:35:02.017220 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.017031 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 04 01:35:02.017220 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.017077 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n7sx9\"" Nov 04 01:35:02.021124 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.019532 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 01:35:02.021284 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.021215 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 04 01:35:02.040276 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040248 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040276 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040278 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-web-config\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040469 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040469 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040322 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlg2l\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-kube-api-access-xlg2l\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040469 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-config-out\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040593 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040535 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040593 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040561 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040686 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040596 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040686 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040774 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040731 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040838 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040868 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040836 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.040868 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.040854 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.141962 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.141925 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.141962 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.141965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.142209 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.141987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.142209 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.142015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.142209 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.142086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-web-config\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.142209 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.142139 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.142209 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.142164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlg2l\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-kube-api-access-xlg2l\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.142515 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.142484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-config-out\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.142627 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.142545 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.142627 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.142570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.142627 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.142619 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.144236 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.142662 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.144236 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.142696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.144236 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.143640 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.144236 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.143702 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.144236 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.144030 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.145618 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.145591 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.146008 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.145985 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.146184 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.146159 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.146293 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.146257 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.146347 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.146255 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.146506 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.146489 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-web-config\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.146572 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.146507 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.146751 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.146736 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-config-out\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.147645 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.147624 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.204996 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.204961 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlg2l\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-kube-api-access-xlg2l\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.356385 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.356353 2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b944f9c8b-bcwpk"] Nov 04 01:35:02.359149 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.359133 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.422912 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.422842 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b944f9c8b-bcwpk"] Nov 04 01:35:02.478002 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.477964 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:02.478490 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.478460 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Nov 04 01:35:02.478617 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.478489 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Nov 04 01:35:02.478617 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.478490 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Nov 04 01:35:02.478709 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.478629 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Nov 04 01:35:02.478759 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.478729 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8q64n\"" Nov 04 01:35:02.478759 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.478737 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-foa7uv69k5mn3\"" Nov 04 01:35:02.478759 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.478731 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Nov 04 01:35:02.534532 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.534502 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" event={"ID":"b98854d2-7827-41a7-b636-5c7a95343ce5","Type":"ContainerStarted","Data":"58941865e117fdf1e44da53c8c1a387535d0a42c3843852cd06c9b975110272d"} Nov 04 01:35:02.537286 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.537252 2572 generic.go:356] "Generic (PLEG): container finished" podID="0681cec5-c66c-49fc-9694-1dd49f6696e5" containerID="ab21e1c3dee51b8c2d974335a59f3a5ead5ef83490adddcfa77d0e9c8e98c873" exitCode=0 Nov 04 01:35:02.537398 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.537311 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76zqz" event={"ID":"0681cec5-c66c-49fc-9694-1dd49f6696e5","Type":"ContainerDied","Data":"ab21e1c3dee51b8c2d974335a59f3a5ead5ef83490adddcfa77d0e9c8e98c873"} Nov 04 01:35:02.546899 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.546872 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.546975 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.546920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.547080 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.547057 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-metrics-client-ca\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.547127 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.547105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.547172 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.547133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-tmp\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.547172 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.547163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrjhd\" (UniqueName: \"kubernetes.io/projected/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-kube-api-access-vrjhd\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.547274 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.547202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-grpc-tls\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.547346 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.547329 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.547387 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.547372 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-tls\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.648559 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.648513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.648720 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.648565 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.648720 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.648639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-metrics-client-ca\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.648720 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.648669 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.648720 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.648692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-tmp\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.648891 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.648719 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrjhd\" (UniqueName: \"kubernetes.io/projected/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-kube-api-access-vrjhd\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.648891 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.648764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-grpc-tls\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.648891 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.648818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.648891 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.648879 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-tls\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.649998 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.649558 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-tmp\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.650727 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.650285 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-metrics-client-ca\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.652144 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.652122 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-tls\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.652249 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.652183 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.652249 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.652203 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.652504 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.652481 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.652661 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.652645 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-grpc-tls\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.654086 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.653544 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.655487 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.655446 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" podStartSLOduration=2.222244354 podStartE2EDuration="3.655434929s" totalImagesPullingTime="1.433190575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:02.654044901 +0000 UTC m=+64.860637094" watchObservedRunningTime="2026-11-04 01:35:02.655434929 +0000 UTC m=+64.862027121" Nov 04 01:35:02.714666 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.714593 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrjhd\" (UniqueName: \"kubernetes.io/projected/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-kube-api-access-vrjhd\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:02.904631 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.904599 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 01:35:02.907250 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:35:02.907219 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721fb020_df00_4a68_aca9_2b5083d413b1.slice/crio-2b84eb6490db90410a1379b40813cfc7ceea5054f14fa03db2fc4100467ea2d1 WatchSource:0}: Error finding container 2b84eb6490db90410a1379b40813cfc7ceea5054f14fa03db2fc4100467ea2d1: Status 404 returned error can't find the container with id 2b84eb6490db90410a1379b40813cfc7ceea5054f14fa03db2fc4100467ea2d1 Nov 04 01:35:02.978090 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:02.978034 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:03.253520 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.253493 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:03.253750 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.253555 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:35:03.306114 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.306083 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 01:35:03.306326 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.306193 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 01:35:03.316693 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.316661 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:35:03.316832 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.316738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:03.353997 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.353963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:35:03.356099 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.356082 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b944f9c8b-bcwpk"] Nov 04 01:35:03.358262 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:35:03.358235 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cb926a_b123_4eaf_88a7_f1c67e1ddf26.slice/crio-0bcb691d9b6080022be5cd529b2ed50936699c38901c1cc925f9c5700879eb18 WatchSource:0}: Error finding container 0bcb691d9b6080022be5cd529b2ed50936699c38901c1cc925f9c5700879eb18: Status 404 returned error can't find the container with id 0bcb691d9b6080022be5cd529b2ed50936699c38901c1cc925f9c5700879eb18 Nov 04 01:35:03.406076 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.406056 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-ldpmc\"" Nov 04 01:35:03.406234 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.406217 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 01:35:03.413903 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.413887 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:03.413966 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.413915 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mh5l6\"" Nov 04 01:35:03.422857 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.422835 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:35:03.467950 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.467060 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 01:35:03.480219 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.480192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:35:03.545416 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.545315 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" event={"ID":"82cb926a-b123-4eaf-88a7-f1c67e1ddf26","Type":"ContainerStarted","Data":"0bcb691d9b6080022be5cd529b2ed50936699c38901c1cc925f9c5700879eb18"} Nov 04 01:35:03.547707 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.547681 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76zqz" event={"ID":"0681cec5-c66c-49fc-9694-1dd49f6696e5","Type":"ContainerStarted","Data":"5aaf2978f9e5011f905d4132579df89fba75978cf1cb40b426342987d2214764"} Nov 04 01:35:03.547837 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.547722 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-76zqz" event={"ID":"0681cec5-c66c-49fc-9694-1dd49f6696e5","Type":"ContainerStarted","Data":"f22b23cc31f38d1a084793cabe9d0b157154ea1c2c71a2dfe759e3f1d8b8bb3b"} Nov 04 01:35:03.548932 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.548910 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerStarted","Data":"2b84eb6490db90410a1379b40813cfc7ceea5054f14fa03db2fc4100467ea2d1"} Nov 04 01:35:03.668887 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.668839 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-76zqz" podStartSLOduration=3.210553018 podStartE2EDuration="4.668825356s" totalImagesPullingTime="1.377261679s" totalInitContainerRuntime="81.010659ms" isStatefulPod=true podCreationTimestamp="2026-11-04 01:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:03.668223243 +0000 UTC m=+65.874815435" watchObservedRunningTime="2026-11-04 01:35:03.668825356 +0000 UTC m=+65.875417616" Nov 04 01:35:03.717843 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.717810 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-vqsf7\"" Nov 04 01:35:03.725851 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.725809 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:35:03.783986 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.783527 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rghpj"] Nov 04 01:35:03.786968 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:35:03.786925 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda265f44c_4a61_4dae_a06d_55472c7bdf21.slice/crio-3ad378d71597e667176d184c27b9207261aa638b878e825a5fe88edb6c27f913 WatchSource:0}: Error finding container 3ad378d71597e667176d184c27b9207261aa638b878e825a5fe88edb6c27f913: Status 404 returned error can't find the container with id 3ad378d71597e667176d184c27b9207261aa638b878e825a5fe88edb6c27f913 Nov 04 01:35:03.798819 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:03.798755 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2kbxl"] Nov 04 01:35:03.801424 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:35:03.801397 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19603f03_3a29_404a_945e_7c489370a778.slice/crio-1d10983a595dacf6436093811c39c4782797a5bda1a3c4f99a868329d7351d2f WatchSource:0}: Error finding container 1d10983a595dacf6436093811c39c4782797a5bda1a3c4f99a868329d7351d2f: Status 404 returned error can't find the container with id 1d10983a595dacf6436093811c39c4782797a5bda1a3c4f99a868329d7351d2f Nov 04 01:35:04.096626 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.096328 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nwps2"] Nov 04 01:35:04.101111 ip-10-0-135-4 kubenswrapper[2572]: W1104 01:35:04.101076 2572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498926f5_18e3_4d4a_8c0c_51d889256af4.slice/crio-64fb9e73ffe68da51d45b8972d91c13f839eafe11cae210b483fdc56a134f909 WatchSource:0}: Error finding container 64fb9e73ffe68da51d45b8972d91c13f839eafe11cae210b483fdc56a134f909: Status 404 returned error can't find the container with id 64fb9e73ffe68da51d45b8972d91c13f839eafe11cae210b483fdc56a134f909 Nov 04 01:35:04.511490 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.511461 2572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-844bd489c5-9phdj"] Nov 04 01:35:04.513292 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.513267 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.556436 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.556405 2572 generic.go:356] "Generic (PLEG): container finished" podID="721fb020-df00-4a68-aca9-2b5083d413b1" containerID="2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d" exitCode=0 Nov 04 01:35:04.556436 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.556444 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerDied","Data":"2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d"} Nov 04 01:35:04.557941 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.557919 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nwps2" event={"ID":"498926f5-18e3-4d4a-8c0c-51d889256af4","Type":"ContainerStarted","Data":"64fb9e73ffe68da51d45b8972d91c13f839eafe11cae210b483fdc56a134f909"} Nov 04 01:35:04.559411 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.559385 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2kbxl" event={"ID":"19603f03-3a29-404a-945e-7c489370a778","Type":"ContainerStarted","Data":"1d10983a595dacf6436093811c39c4782797a5bda1a3c4f99a868329d7351d2f"} Nov 04 01:35:04.560748 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.560726 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rghpj" event={"ID":"a265f44c-4a61-4dae-a06d-55472c7bdf21","Type":"ContainerStarted","Data":"3ad378d71597e667176d184c27b9207261aa638b878e825a5fe88edb6c27f913"} Nov 04 01:35:04.562203 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.562174 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r559\" (UniqueName: \"kubernetes.io/projected/7d1eb32a-767f-4594-86f0-2e757881d769-kube-api-access-5r559\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.562289 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.562240 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-tls\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.562605 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.562577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-metrics-server-audit-profiles\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.562695 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.562649 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-client-ca-bundle\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.562942 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.562909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.563043 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.563028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d1eb32a-767f-4594-86f0-2e757881d769-audit-log\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.563098 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.563062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-client-certs\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.566988 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.566938 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Nov 04 01:35:04.566988 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.566938 2572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 04 01:35:04.575012 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.574376 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-844bd489c5-9phdj"] Nov 04 01:35:04.628544 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.628404 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Nov 04 01:35:04.628714 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.628623 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-84fqpgig3nv4s\"" Nov 04 01:35:04.628714 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.628627 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Nov 04 01:35:04.628714 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.628659 2572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vs9fm\"" Nov 04 01:35:04.664201 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.664170 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d1eb32a-767f-4594-86f0-2e757881d769-audit-log\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.664348 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.664214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-client-certs\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.664348 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.664264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r559\" (UniqueName: \"kubernetes.io/projected/7d1eb32a-767f-4594-86f0-2e757881d769-kube-api-access-5r559\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.664348 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.664295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-tls\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.664348 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.664338 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-metrics-server-audit-profiles\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.664551 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.664364 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-client-ca-bundle\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.664551 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.664404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.664649 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.664610 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d1eb32a-767f-4594-86f0-2e757881d769-audit-log\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.665217 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.665167 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.665931 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.665808 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-metrics-server-audit-profiles\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.667882 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.667858 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-client-ca-bundle\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.668254 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.668217 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-tls\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.668758 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.668740 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-client-certs\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.727476 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.727446 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r559\" (UniqueName: \"kubernetes.io/projected/7d1eb32a-767f-4594-86f0-2e757881d769-kube-api-access-5r559\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:04.842512 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:04.842236 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:05.272794 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:05.272643 2572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-844bd489c5-9phdj"] Nov 04 01:35:05.501077 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:05.501043 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4m5nq" Nov 04 01:35:05.526323 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:05.526241 2572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:05.526323 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:05.526302 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:05.532796 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:05.532755 2572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:05.576470 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:05.576396 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" event={"ID":"7d1eb32a-767f-4594-86f0-2e757881d769","Type":"ContainerStarted","Data":"cdad6780c1d0a01eec120f8263fe33cb49bf1923d68a4d74ec6a865e29160e40"} Nov 04 01:35:05.582433 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:05.582407 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:06.586951 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:06.586751 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" event={"ID":"82cb926a-b123-4eaf-88a7-f1c67e1ddf26","Type":"ContainerStarted","Data":"e02d0b2b721e55344e8fa31dbb8626503e77b06bf048f9a92999343e644b58ab"} Nov 04 01:35:06.586951 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:06.586858 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" event={"ID":"82cb926a-b123-4eaf-88a7-f1c67e1ddf26","Type":"ContainerStarted","Data":"23a621f9506ae0af2a5883253e3709130e20a425ebadc49a4604aad29005c207"} Nov 04 01:35:06.593879 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:06.593797 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2kbxl" event={"ID":"19603f03-3a29-404a-945e-7c489370a778","Type":"ContainerStarted","Data":"bb305a7e9638958373f29b4ddb8d220fd5ac02cd5af75505466d001a8299ece5"} Nov 04 01:35:06.593879 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:06.593845 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2kbxl" event={"ID":"19603f03-3a29-404a-945e-7c489370a778","Type":"ContainerStarted","Data":"4d0e39ce89692e659724e4e499337e09bcd1f49710ea36845dfee65df50a76b2"} Nov 04 01:35:06.712040 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:06.711973 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2kbxl" podStartSLOduration=66.909936019 podStartE2EDuration="1m8.711954327s" totalImagesPullingTime="1.802018308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:06.710437511 +0000 UTC m=+68.917029705" watchObservedRunningTime="2026-11-04 01:35:06.711954327 +0000 UTC m=+68.918546520" Nov 04 01:35:07.613281 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:07.613252 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerStarted","Data":"eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b"} Nov 04 01:35:07.613670 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:07.613318 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerStarted","Data":"1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413"} Nov 04 01:35:07.613670 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:07.613345 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerStarted","Data":"7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0"} Nov 04 01:35:07.613670 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:07.613368 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerStarted","Data":"ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e"} Nov 04 01:35:07.616465 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:07.616441 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" event={"ID":"82cb926a-b123-4eaf-88a7-f1c67e1ddf26","Type":"ContainerStarted","Data":"7bda86e6ac8bf479e433647ba5ea9c792e165021ffeecfc25819f81a25e61276"} Nov 04 01:35:08.624950 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:08.624905 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" event={"ID":"82cb926a-b123-4eaf-88a7-f1c67e1ddf26","Type":"ContainerStarted","Data":"7752628a4c687febc9889486828343a3b97a3228de98b323fd37516af87c4085"} Nov 04 01:35:08.625408 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:08.624984 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" event={"ID":"82cb926a-b123-4eaf-88a7-f1c67e1ddf26","Type":"ContainerStarted","Data":"2ccefa00a8a243d6910d5255b37ad076e0064a34c616358a20e4996a903d1305"} Nov 04 01:35:08.625408 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:08.625021 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" event={"ID":"82cb926a-b123-4eaf-88a7-f1c67e1ddf26","Type":"ContainerStarted","Data":"f96fee4c2cbf0b7f146052e963c8123e48f8190922650bafe1e28976ef5b66c0"} Nov 04 01:35:08.625408 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:08.625258 2572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:08.626827 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:08.626772 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" event={"ID":"7d1eb32a-767f-4594-86f0-2e757881d769","Type":"ContainerStarted","Data":"98de8c8bf88e10152b70234a376ee9efb8a14263a8d5534788d57f61e6ed4e9b"} Nov 04 01:35:08.632398 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:08.632372 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerStarted","Data":"1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52"} Nov 04 01:35:08.632482 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:08.632442 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerStarted","Data":"40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8"} Nov 04 01:35:08.795897 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:08.795830 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" podStartSLOduration=2.421906393 podStartE2EDuration="6.795812439s" totalImagesPullingTime="4.373906046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:08.795231194 +0000 UTC m=+71.001823431" watchObservedRunningTime="2026-11-04 01:35:08.795812439 +0000 UTC m=+71.002404645" Nov 04 01:35:08.915416 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:08.915349 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" podStartSLOduration=2.310597956 podStartE2EDuration="4.91532679s" totalImagesPullingTime="2.604728834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:08.914503317 +0000 UTC m=+71.121095534" watchObservedRunningTime="2026-11-04 01:35:08.91532679 +0000 UTC m=+71.121919008" Nov 04 01:35:09.054040 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:09.053933 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.162603938 podStartE2EDuration="8.053917089s" totalImagesPullingTime="4.877522988s" totalInitContainerRuntime="13.790163ms" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:09.051257132 +0000 UTC m=+71.257849384" watchObservedRunningTime="2026-11-04 01:35:09.053917089 +0000 UTC m=+71.260509281" Nov 04 01:35:09.638901 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:09.638832 2572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nwps2" event={"ID":"498926f5-18e3-4d4a-8c0c-51d889256af4","Type":"ContainerStarted","Data":"625b6e07f0a59e6d950d80845a692fbdcc15e379ec6a91a5c1812aac59174c5e"} Nov 04 01:35:09.757711 ip-10-0-135-4 kubenswrapper[2572]: I1104 01:35:09.757644 2572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nwps2" podStartSLOduration=66.93191727 podStartE2EDuration="1m11.757626054s" totalImagesPullingTime="4.825708784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:09.756950229 +0000 UTC m=+71.963542422" watchObservedRunningTime="2026-11-04 01:35:09.757626054 +0000 UTC m=+71.964218247" Nov 04 01:35:10.463902 ip-10-0-135-4 systemd[1]: Stopping Kubernetes Kubelet... Nov 04 01:35:10.480160 ip-10-0-135-4 systemd[1]: kubelet.service: Deactivated successfully. Nov 04 01:35:10.480330 ip-10-0-135-4 systemd[1]: Stopped Kubernetes Kubelet. Nov 04 01:35:10.480379 ip-10-0-135-4 systemd[1]: kubelet.service: Consumed 4.159s CPU time. Nov 04 01:35:10.495298 ip-10-0-135-4 systemd[1]: Starting Kubernetes Kubelet... Nov 04 01:35:10.557560 ip-10-0-135-4 kubenswrapper[5537]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 01:35:10.557560 ip-10-0-135-4 kubenswrapper[5537]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 01:35:10.557560 ip-10-0-135-4 kubenswrapper[5537]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 01:35:10.557560 ip-10-0-135-4 kubenswrapper[5537]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 01:35:10.559673 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559581 5537 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:35:10.559673 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559673 5537 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559677 5537 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559680 5537 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559684 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559687 5537 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559690 5537 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559693 5537 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559696 5537 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559699 5537 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559702 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559705 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559708 5537 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559711 5537 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559713 5537 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559716 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559719 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559722 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559724 5537 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559727 5537 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559730 5537 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:35:10.559734 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559733 5537 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559741 5537 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559744 5537 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559747 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559750 5537 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559753 5537 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559756 5537 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559758 5537 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559761 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559764 5537 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559766 5537 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559769 5537 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559772 5537 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559775 5537 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559796 5537 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559800 5537 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559803 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559806 5537 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559808 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559811 5537 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:35:10.560227 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559814 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559817 5537 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559820 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559822 5537 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559825 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559827 5537 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559830 5537 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559833 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559836 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559838 5537 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559841 5537 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559844 5537 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559847 5537 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559850 5537 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559853 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559855 5537 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559858 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559861 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559864 5537 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:35:10.560707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559866 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559869 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559872 5537 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559875 5537 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559877 5537 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559880 5537 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559883 5537 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559885 5537 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559889 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559892 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559895 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559897 5537 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559901 5537 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559904 5537 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559906 5537 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559909 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559912 5537 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559915 5537 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559917 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:35:10.561176 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559920 5537 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559923 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559926 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559928 5537 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559931 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559935 5537 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559938 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559942 5537 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559945 5537 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559948 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559951 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559955 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559961 5537 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559966 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559971 5537 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559978 5537 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559984 5537 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559989 5537 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559994 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:35:10.561634 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.559998 5537 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560001 5537 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560005 5537 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560010 5537 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560013 5537 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560018 5537 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560022 5537 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560027 5537 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560905 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560914 5537 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560917 5537 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560920 5537 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560923 5537 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560926 5537 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560929 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560931 5537 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560934 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560937 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560939 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560942 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:35:10.562111 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560945 5537 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560948 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560950 5537 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560953 5537 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560956 5537 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560959 5537 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560961 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560964 5537 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560966 5537 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560969 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560972 5537 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560974 5537 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560978 5537 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560980 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560983 5537 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560986 5537 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560989 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560991 5537 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560994 5537 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.560997 5537 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:35:10.562600 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561000 5537 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561003 5537 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561006 5537 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561008 5537 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561011 5537 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561014 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561017 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561019 5537 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561022 5537 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561024 5537 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561027 5537 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561030 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561033 5537 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561036 5537 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561038 5537 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561041 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561044 5537 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561048 5537 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561051 5537 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:35:10.563118 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561055 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561058 5537 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561060 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561063 5537 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561066 5537 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561068 5537 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561072 5537 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561074 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561077 5537 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561080 5537 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561083 5537 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561085 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561088 5537 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561090 5537 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561093 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561096 5537 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561099 5537 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561102 5537 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561106 5537 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:35:10.563604 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561110 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561113 5537 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561116 5537 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561122 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561124 5537 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561128 5537 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561130 5537 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561133 5537 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561136 5537 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561138 5537 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561141 5537 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561144 5537 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561147 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561149 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561152 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561155 5537 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561158 5537 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561160 5537 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561163 5537 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561166 5537 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:35:10.564072 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561168 5537 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561171 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561174 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561176 5537 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561179 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561182 5537 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561184 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561189 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561192 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561195 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561197 5537 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561200 5537 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561202 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561205 5537 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561207 5537 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561211 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561723 5537 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561729 5537 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561731 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:35:10.564581 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561734 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561737 5537 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561740 5537 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561743 5537 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561745 5537 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561748 5537 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561751 5537 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561754 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561756 5537 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561759 5537 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561762 5537 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561764 5537 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561767 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561770 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561772 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561793 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561797 5537 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561800 5537 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561803 5537 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:35:10.565087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561806 5537 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561808 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561811 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561814 5537 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561817 5537 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561819 5537 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561822 5537 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561825 5537 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561827 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561831 5537 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561834 5537 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561836 5537 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561839 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561842 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561844 5537 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561847 5537 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561850 5537 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561852 5537 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561855 5537 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:35:10.565552 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561858 5537 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561860 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561863 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561866 5537 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561868 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561871 5537 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561874 5537 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561876 5537 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561879 5537 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561881 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561884 5537 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561886 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561889 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561892 5537 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561894 5537 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561897 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561900 5537 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561902 5537 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561906 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561910 5537 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:35:10.566057 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561913 5537 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561916 5537 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561920 5537 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561924 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561929 5537 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561933 5537 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561936 5537 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561938 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561941 5537 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561944 5537 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561946 5537 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561949 5537 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561952 5537 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561954 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561957 5537 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561960 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561962 5537 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561965 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561968 5537 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:35:10.566558 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561971 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561973 5537 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561976 5537 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561979 5537 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561982 5537 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561984 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561987 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561990 5537 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561992 5537 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561995 5537 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.561999 5537 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562001 5537 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562004 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562007 5537 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562009 5537 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562012 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562015 5537 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562017 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562020 5537 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562023 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:35:10.567034 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562025 5537 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562028 5537 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562030 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562033 5537 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562035 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562039 5537 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562134 5537 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562141 5537 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562154 5537 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562158 5537 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562163 5537 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562167 5537 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562171 5537 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562175 5537 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562178 5537 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562181 5537 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562185 5537 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562188 5537 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562191 5537 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562194 5537 flags.go:64] FLAG: --cgroup-root="" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562197 5537 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562200 5537 flags.go:64] FLAG: --client-ca-file="" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562203 5537 flags.go:64] FLAG: --cloud-provider="external" Nov 04 01:35:10.567524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562207 5537 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562211 5537 flags.go:64] FLAG: --cluster-domain="" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562214 5537 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562217 5537 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562220 5537 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562226 5537 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562230 5537 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562233 5537 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562236 5537 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562239 5537 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562242 5537 flags.go:64] FLAG: --contention-profiling="false" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562245 5537 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562248 5537 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562252 5537 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562255 5537 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562259 5537 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562262 5537 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562265 5537 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562268 5537 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562271 5537 flags.go:64] FLAG: --enable-server="true" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562274 5537 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562279 5537 flags.go:64] FLAG: --event-burst="100" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562283 5537 flags.go:64] FLAG: --event-qps="50" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562286 5537 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 01:35:10.568127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562289 5537 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562292 5537 flags.go:64] FLAG: --eviction-hard="" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562296 5537 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562299 5537 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562303 5537 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562306 5537 flags.go:64] FLAG: --eviction-soft="" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562309 5537 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562312 5537 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562315 5537 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562318 5537 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562321 5537 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562324 5537 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562327 5537 flags.go:64] FLAG: --feature-gates="" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562333 5537 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562336 5537 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562339 5537 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562343 5537 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562346 5537 flags.go:64] FLAG: --healthz-port="10248" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562349 5537 flags.go:64] FLAG: --help="false" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562352 5537 flags.go:64] FLAG: --hostname-override="ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562356 5537 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562359 5537 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562362 5537 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 01:35:10.568703 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562365 5537 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562369 5537 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562372 5537 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562375 5537 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562378 5537 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562381 5537 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562386 5537 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562389 5537 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562392 5537 flags.go:64] FLAG: --kube-reserved="" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562395 5537 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562398 5537 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562401 5537 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562404 5537 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562407 5537 flags.go:64] FLAG: --lock-file="" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562410 5537 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562413 5537 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562416 5537 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562422 5537 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562425 5537 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562428 5537 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562431 5537 flags.go:64] FLAG: --logging-format="text" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562434 5537 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562439 5537 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562442 5537 flags.go:64] FLAG: --manifest-url="" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562445 5537 flags.go:64] FLAG: --manifest-url-header="" Nov 04 01:35:10.569558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562449 5537 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562452 5537 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562456 5537 flags.go:64] FLAG: --max-pods="110" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562459 5537 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562462 5537 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562465 5537 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562468 5537 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562471 5537 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562475 5537 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562478 5537 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562484 5537 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562488 5537 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562491 5537 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562495 5537 flags.go:64] FLAG: --pod-cidr="" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562498 5537 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562501 5537 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562504 5537 flags.go:64] FLAG: --pods-per-core="0" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562507 5537 flags.go:64] FLAG: --port="10250" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562510 5537 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562514 5537 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-085ce3a0a47c5dcf0" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562517 5537 flags.go:64] FLAG: --qos-reserved="" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562520 5537 flags.go:64] FLAG: --read-only-port="10255" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562523 5537 flags.go:64] FLAG: --register-node="true" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562526 5537 flags.go:64] FLAG: --register-with-taints="" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562530 5537 flags.go:64] FLAG: --registry-burst="10" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562533 5537 flags.go:64] FLAG: --registry-qps="5" Nov 04 01:35:10.570313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562536 5537 flags.go:64] FLAG: --reserved-cpus="" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562539 5537 flags.go:64] FLAG: --reserved-memory="" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562543 5537 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562547 5537 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562550 5537 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562554 5537 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562557 5537 flags.go:64] FLAG: --runonce="false" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562560 5537 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562563 5537 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562566 5537 flags.go:64] FLAG: --seccomp-default="false" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562569 5537 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562572 5537 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562575 5537 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562578 5537 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562581 5537 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562584 5537 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562587 5537 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562590 5537 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562593 5537 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562597 5537 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562600 5537 flags.go:64] FLAG: --system-cgroups="" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562603 5537 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562608 5537 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562611 5537 flags.go:64] FLAG: --tls-cert-file="" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562614 5537 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 01:35:10.571026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562619 5537 flags.go:64] FLAG: --tls-min-version="" Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562622 5537 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562625 5537 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562628 5537 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562631 5537 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562634 5537 flags.go:64] FLAG: --v="2" Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562639 5537 flags.go:64] FLAG: --version="false" Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562643 5537 flags.go:64] FLAG: --vmodule="" Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562647 5537 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.562651 5537 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562815 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562822 5537 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562826 5537 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562829 5537 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562832 5537 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562834 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562837 5537 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562840 5537 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562843 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562845 5537 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562848 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:35:10.571682 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562851 5537 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562854 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562856 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562859 5537 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562863 5537 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562867 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562870 5537 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562873 5537 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562876 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562878 5537 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562881 5537 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562884 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562887 5537 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562889 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562892 5537 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562895 5537 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562897 5537 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562900 5537 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562902 5537 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562905 5537 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:35:10.572211 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562908 5537 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562913 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562916 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562919 5537 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562921 5537 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562924 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562926 5537 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562929 5537 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562932 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562935 5537 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562938 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562940 5537 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562943 5537 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562945 5537 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562948 5537 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562951 5537 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562954 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562958 5537 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562961 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:35:10.572903 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562963 5537 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562966 5537 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562976 5537 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562979 5537 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562982 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562985 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562988 5537 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562991 5537 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562993 5537 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562996 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.562999 5537 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563003 5537 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563007 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563011 5537 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563016 5537 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563020 5537 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563023 5537 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563026 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563029 5537 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:35:10.573454 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563031 5537 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563034 5537 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563037 5537 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563040 5537 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563042 5537 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563045 5537 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563048 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563050 5537 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563053 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563056 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563058 5537 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563062 5537 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563066 5537 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563069 5537 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563072 5537 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563075 5537 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563078 5537 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563080 5537 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563083 5537 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:35:10.574126 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563086 5537 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563089 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563091 5537 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563094 5537 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563096 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563099 5537 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563102 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563105 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563109 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563112 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563115 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563117 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563120 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563123 5537 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563126 5537 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563129 5537 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563131 5537 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:35:10.574607 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563134 5537 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.563162 5537 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563216 5537 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563221 5537 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563225 5537 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563228 5537 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563231 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563234 5537 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563238 5537 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563242 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563245 5537 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563247 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563250 5537 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563253 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563255 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563259 5537 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:35:10.575193 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563261 5537 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563264 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563267 5537 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563269 5537 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563272 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563274 5537 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563277 5537 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563281 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563283 5537 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563286 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563293 5537 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563296 5537 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563299 5537 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563301 5537 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563304 5537 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563306 5537 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563309 5537 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563312 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563314 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563317 5537 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:35:10.575691 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563320 5537 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563322 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563325 5537 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563328 5537 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563332 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563335 5537 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563338 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563341 5537 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563343 5537 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563346 5537 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563349 5537 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563351 5537 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563354 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563357 5537 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563359 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563362 5537 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563364 5537 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563367 5537 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563370 5537 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:35:10.576314 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563374 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563376 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563379 5537 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563382 5537 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563385 5537 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563387 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563390 5537 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563394 5537 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563398 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563401 5537 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563403 5537 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563406 5537 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563408 5537 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563411 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563414 5537 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563416 5537 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563419 5537 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563423 5537 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563425 5537 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:35:10.576794 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563428 5537 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563431 5537 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563433 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563436 5537 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563439 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563441 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563444 5537 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563446 5537 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563450 5537 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563454 5537 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563457 5537 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563460 5537 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563462 5537 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563467 5537 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563470 5537 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563472 5537 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563475 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563477 5537 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563480 5537 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:35:10.577278 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563483 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563486 5537 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563488 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563491 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563493 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563496 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563498 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563501 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563504 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563506 5537 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563509 5537 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563526 5537 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563530 5537 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563534 5537 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.563537 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.567291 5537 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.567312 5537 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.567329 5537 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.567333 5537 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 01:35:10.577835 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567388 5537 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567394 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567397 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567402 5537 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567406 5537 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567410 5537 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567413 5537 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567416 5537 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567419 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567421 5537 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567424 5537 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567426 5537 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567429 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567432 5537 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567435 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567438 5537 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567440 5537 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567443 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567446 5537 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:35:10.578329 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567449 5537 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567452 5537 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567455 5537 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567458 5537 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567460 5537 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567463 5537 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567466 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567469 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567471 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567474 5537 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567477 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567480 5537 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567483 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567486 5537 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567488 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567491 5537 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567494 5537 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567497 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567499 5537 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567502 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:35:10.578795 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567504 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567507 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567509 5537 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567512 5537 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567515 5537 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567517 5537 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567520 5537 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567523 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567526 5537 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567528 5537 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567531 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567534 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567537 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567540 5537 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567542 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567545 5537 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567548 5537 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567551 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567554 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567556 5537 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:35:10.579286 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567559 5537 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567562 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567564 5537 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567567 5537 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567570 5537 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567573 5537 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567575 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567578 5537 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567580 5537 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567583 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567586 5537 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567588 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567591 5537 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567593 5537 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567596 5537 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567599 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567602 5537 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567604 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567607 5537 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:35:10.579756 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567610 5537 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567612 5537 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567615 5537 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567617 5537 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567620 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567622 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567625 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567628 5537 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567630 5537 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567633 5537 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567635 5537 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567638 5537 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567640 5537 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567643 5537 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567645 5537 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567648 5537 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567651 5537 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567654 5537 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567656 5537 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567659 5537 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:35:10.580250 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567662 5537 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567664 5537 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567667 5537 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567669 5537 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567672 5537 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567675 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567677 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567681 5537 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.567744 5537 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567922 5537 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567928 5537 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567931 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567934 5537 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567937 5537 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567940 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:35:10.580715 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567943 5537 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567965 5537 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567969 5537 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567972 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567975 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567977 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567980 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567982 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567985 5537 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567988 5537 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567991 5537 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567993 5537 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567996 5537 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.567999 5537 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568002 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568007 5537 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568011 5537 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568015 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568019 5537 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:35:10.581087 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568023 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568028 5537 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568032 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568035 5537 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568037 5537 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568040 5537 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568043 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568045 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568048 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568051 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568054 5537 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568057 5537 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568059 5537 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568062 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568065 5537 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568067 5537 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568070 5537 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568073 5537 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568076 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:35:10.581525 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568079 5537 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568081 5537 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568084 5537 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568086 5537 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568089 5537 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568091 5537 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568094 5537 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568097 5537 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568099 5537 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568102 5537 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568105 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568107 5537 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568110 5537 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568113 5537 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568115 5537 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568118 5537 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568122 5537 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568126 5537 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568129 5537 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:35:10.581998 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568132 5537 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568135 5537 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568137 5537 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568140 5537 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568146 5537 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568148 5537 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568151 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568154 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568156 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568159 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568162 5537 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568165 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568167 5537 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568170 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568173 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568175 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568178 5537 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568181 5537 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568183 5537 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568186 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:35:10.582436 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568188 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568191 5537 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568194 5537 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568196 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568199 5537 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568202 5537 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568205 5537 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568207 5537 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568210 5537 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568212 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568215 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568218 5537 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568220 5537 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568223 5537 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568225 5537 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568228 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568232 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568234 5537 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568237 5537 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568240 5537 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:35:10.582916 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568244 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568247 5537 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568250 5537 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.568276 5537 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568328 5537 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568332 5537 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568335 5537 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568338 5537 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568341 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568343 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568346 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568349 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568352 5537 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568354 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568357 5537 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568359 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 01:35:10.583428 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568362 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568365 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568368 5537 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568370 5537 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568373 5537 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568375 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568378 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568381 5537 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568383 5537 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568386 5537 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568388 5537 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568391 5537 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568394 5537 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568398 5537 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568400 5537 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568405 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568407 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568410 5537 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568413 5537 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568415 5537 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 01:35:10.583830 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568418 5537 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568421 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568423 5537 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568426 5537 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568428 5537 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568432 5537 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568436 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568439 5537 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568442 5537 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568445 5537 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568447 5537 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568450 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568453 5537 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568456 5537 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568459 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568461 5537 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568464 5537 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568467 5537 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568470 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568472 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 01:35:10.584298 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568475 5537 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568477 5537 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568480 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568482 5537 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568485 5537 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568489 5537 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568492 5537 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568495 5537 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568499 5537 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568501 5537 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568504 5537 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568507 5537 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568509 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568512 5537 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568514 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568517 5537 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568520 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568522 5537 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568525 5537 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 01:35:10.584766 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568527 5537 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568530 5537 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568533 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568535 5537 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568538 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568541 5537 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568543 5537 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568546 5537 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568549 5537 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568552 5537 feature_gate.go:386] unrecognized feature gate: Example Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568554 5537 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568557 5537 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568559 5537 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568562 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568564 5537 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568567 5537 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568570 5537 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568572 5537 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568576 5537 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 01:35:10.585347 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568578 5537 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568582 5537 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568585 5537 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568588 5537 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568590 5537 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568593 5537 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568596 5537 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568598 5537 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568601 5537 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568604 5537 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568606 5537 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568611 5537 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568615 5537 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568618 5537 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568620 5537 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:10.568623 5537 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.568672 5537 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.570560 5537 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.570612 5537 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 04 01:35:10.585833 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.570811 5537 server.go:1014] "Starting client certificate rotation" Nov 04 01:35:10.586389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.570940 5537 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 01:35:10.586389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.570999 5537 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 01:28:58 +0000 UTC" deadline="2028-08-01 11:30:20.783047248 +0000 UTC" Nov 04 01:35:10.586389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.571026 5537 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15273h55m10.212022639s" Nov 04 01:35:10.586389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.571277 5537 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 01:35:10.586389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.572346 5537 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 01:35:10.586389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.573553 5537 log.go:25] "Validated CRI v1 runtime API" Nov 04 01:35:10.586389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.575395 5537 log.go:25] "Validated CRI v1 image API" Nov 04 01:35:10.586389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.576195 5537 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 01:35:10.586389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.578249 5537 fs.go:135] Filesystem UUIDs: map[3bf8c763-c612-4654-b952-7f67561f2026:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ebba7584-4719-4ebb-be50-05d4f5001d6b:/dev/nvme0n1p3] Nov 04 01:35:10.586838 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.578269 5537 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0417884e5936d24966ea3c9cd23534419703d2b485609309fae6d36cecb223d5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0417884e5936d24966ea3c9cd23534419703d2b485609309fae6d36cecb223d5/userdata/shm major:0 minor:273 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0bcb691d9b6080022be5cd529b2ed50936699c38901c1cc925f9c5700879eb18/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0bcb691d9b6080022be5cd529b2ed50936699c38901c1cc925f9c5700879eb18/userdata/shm major:0 minor:324 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/19ca73d86de82b55f012fb3008c71a49c2b5b1082f26573ae4c897069446c66a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/19ca73d86de82b55f012fb3008c71a49c2b5b1082f26573ae4c897069446c66a/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1d10983a595dacf6436093811c39c4782797a5bda1a3c4f99a868329d7351d2f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1d10983a595dacf6436093811c39c4782797a5bda1a3c4f99a868329d7351d2f/userdata/shm major:0 minor:332 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/26a5cb0e95819f513da6dae01a1b2b019546b91c299328f616c69863371acbd0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/26a5cb0e95819f513da6dae01a1b2b019546b91c299328f616c69863371acbd0/userdata/shm major:0 minor:253 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2b84eb6490db90410a1379b40813cfc7ceea5054f14fa03db2fc4100467ea2d1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2b84eb6490db90410a1379b40813cfc7ceea5054f14fa03db2fc4100467ea2d1/userdata/shm major:0 minor:303 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/35fa75652d6ebe1c9daacc932fd1d55acf245056c8f3e09faf84653a0e464d67/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/35fa75652d6ebe1c9daacc932fd1d55acf245056c8f3e09faf84653a0e464d67/userdata/shm major:0 minor:66 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/392da7767d47a216a91d6c6d8f07839eadb86247e82c34b1b4531e09c65328e9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/392da7767d47a216a91d6c6d8f07839eadb86247e82c34b1b4531e09c65328e9/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3ad378d71597e667176d184c27b9207261aa638b878e825a5fe88edb6c27f913/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3ad378d71597e667176d184c27b9207261aa638b878e825a5fe88edb6c27f913/userdata/shm major:0 minor:330 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/41eb00308cef99316727394b04c9ad05d1d72370cd39a3688e18c6a2003a708b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/41eb00308cef99316727394b04c9ad05d1d72370cd39a3688e18c6a2003a708b/userdata/shm major:0 minor:266 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/626d88e085ac0160cb44307d5f6371aeafeae814a5517e5e9353633c30fd237a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/626d88e085ac0160cb44307d5f6371aeafeae814a5517e5e9353633c30fd237a/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/64fb9e73ffe68da51d45b8972d91c13f839eafe11cae210b483fdc56a134f909/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/64fb9e73ffe68da51d45b8972d91c13f839eafe11cae210b483fdc56a134f909/userdata/shm major:0 minor:335 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/702f2a38bbaab88979cb7e61fbcafe483a7cadf76533527c317a29f7b6105d67/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/702f2a38bbaab88979cb7e61fbcafe483a7cadf76533527c317a29f7b6105d67/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7890e45aa0a903c13b3e78e544cd9f4b48fdf38a52d214154379654bb9323466/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7890e45aa0a903c13b3e78e544cd9f4b48fdf38a52d214154379654bb9323466/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/78f30fc12ec012914109eefbc3ff29f7036bdb595750aa4820c54cf4df5f8923/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/78f30fc12ec012914109eefbc3ff29f7036bdb595750aa4820c54cf4df5f8923/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b3668f558975076724138b078984c76886cfab99215c8c1ef767318aaee145d1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b3668f558975076724138b078984c76886cfab99215c8c1ef767318aaee145d1/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b887b9e7479eb1fb631874ef40e2adc7fbcb62c842e8ad6140166fbc271b8c53/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b887b9e7479eb1fb631874ef40e2adc7fbcb62c842e8ad6140166fbc271b8c53/userdata/shm major:0 minor:62 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c984ff65bb8f97f43bf87f9fbcac89885e299aa841e0b5f7e68c6ca49c5fb2d3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c984ff65bb8f97f43bf87f9fbcac89885e299aa841e0b5f7e68c6ca49c5fb2d3/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cdad6780c1d0a01eec120f8263fe33cb49bf1923d68a4d74ec6a865e29160e40/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cdad6780c1d0a01eec120f8263fe33cb49bf1923d68a4d74ec6a865e29160e40/userdata/shm major:0 minor:347 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e110f56948d18b5c9d8ad00b192bbd1b378022d38503d37af65304c72335c9ac/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e110f56948d18b5c9d8ad00b192bbd1b378022d38503d37af65304c72335c9ac/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fc287e8cbd33968059145dbcfd79aae31247e76e0ed5c5c6cc3a6de81cd3dd7f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fc287e8cbd33968059145dbcfd79aae31247e76e0ed5c5c6cc3a6de81cd3dd7f/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fd86efd06ac4cd0192bb6bd60c931e398c24f0947aa7de4090e039379221f869/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fd86efd06ac4cd0192bb6bd60c931e398c24f0947aa7de4090e039379221f869/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0681cec5-c66c-49fc-9694-1dd49f6696e5/volumes/kubernetes.io~projected/kube-api-access-977vg:{mountpoint:/var/lib/kubelet/pods/0681cec5-c66c-49fc-9694-1dd49f6696e5/volumes/kubernetes.io~projected/kube-api-access-977vg major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0681cec5-c66c-49fc-9694-1dd49f6696e5/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/0681cec5-c66c-49fc-9694-1dd49f6696e5/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:268 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0681cec5-c66c-49fc-9694-1dd49f6696e5/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/0681cec5-c66c-49fc-9694-1dd49f6696e5/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07394429-d52a-4e4f-bf9d-9b33be514f87/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/07394429-d52a-4e4f-bf9d-9b33be514f87/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07394429-d52a-4e4f-bf9d-9b33be514f87/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/07394429-d52a-4e4f-bf9d-9b33be514f87/volumes/kubernetes.io~empty-dir/tmp major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07394429-d52a-4e4f-bf9d-9b33be514f87/volumes/kubernetes.io~projected/kube-api-access-nwzh7:{mountpoint:/var/lib/kubelet/pods/07394429-d52a-4e4f-bf9d-9b33be514f87/volumes/kubernetes.io~projected/kube-api-access-nwzh7 major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1080d3e1-b834-48f5-b2aa-28e01af0bff5/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/1080d3e1-b834-48f5-b2aa-28e01af0bff5/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1080d3e1-b834-48f5-b2aa-28e01af0bff5/volumes/kubernetes.io~projected/kube-api-access-2pvrf:{mountpoint:/var/lib/kubelet/pods/1080d3e1-b834-48f5-b2aa-28e01af0bff5/volumes/kubernetes.io~projected/kube-api-access-2pvrf major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1080d3e1-b834-48f5-b2aa-28e01af0bff5/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/1080d3e1-b834-48f5-b2aa-28e01af0bff5/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/16dce250-b54a-40e2-a387-527df0330eb3/volumes/kubernetes.io~projected/kube-api-access-q5zjf:{mountpoint:/var/lib/kubelet/pods/16dce250-b54a-40e2-a387-527df0330eb3/volumes/kubernetes.io~projected/kube-api-access-q5zjf major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/16dce250-b54a-40e2-a387-527df0330eb3/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/16dce250-b54a-40e2-a387-527df0330eb3/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/19603f03-3a29-404a-945e-7c489370a778/volumes/kubernetes.io~projected/kube-api-access-gjdw8:{mountpoint:/var/lib/kubelet/pods/19603f03-3a29-404a-945e-7c489370a778/volumes/kubernetes.io~projected/kube-api-access-gjdw8 major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/19603f03-3a29-404a-945e-7c489370a778/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/19603f03-3a29-404a-945e-7c489370a778/volumes/kubernetes.io~secret/metrics-certs major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a4890fd-1ea5-4b53-9b71-b641ad07ad59/volumes/kubernetes.io~projected/kube-api-access-9xqrc:{mountpoint:/var/lib/kubelet/pods/1a4890fd-1ea5-4b53-9b71-b641ad07ad59/volumes/kubernetes.io~projected/kube-api-access-9xqrc major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a4890fd-1ea5-4b53-9b71-b641ad07ad59/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/1a4890fd-1ea5-4b53-9b71-b641ad07ad59/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3051e1d4-8634-414d-ab3e-6c970a0a5cac/volumes/kubernetes.io~projected/kube-api-access-s7bvd:{mountpoint:/var/lib/kubelet/pods/3051e1d4-8634-414d-ab3e-6c970a0a5cac/volumes/kubernetes.io~projected/kube-api-access-s7bvd major:0 minor:252 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3051e1d4-8634-414d-ab3e-6c970a0a5cac/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/3051e1d4-8634-414d-ab3e-6c970a0a5cac/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:244 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3051e1d4-8634-414d-ab3e-6c970a0a5cac/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/3051e1d4-8634-414d-ab3e-6c970a0a5cac/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:243 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/498926f5-18e3-4d4a-8c0c-51d889256af4/volumes/kubernetes.io~projected/kube-api-access-hhtdj:{mountpoint:/var/lib/kubelet/pods/498926f5-18e3-4d4a-8c0c-51d889256af4/volumes/kubernetes.io~projected/kube-api-access-hhtdj major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/542f0dbb-ab95-4719-bcf2-6b0441d0feea/volumes/kubernetes.io~projected/kube-api-access-8wqvn:{mountpoint:/var/lib/kubelet/pods/542f0dbb-ab95-4719-bcf2-6b0441d0feea/volumes/kubernetes.io~projected/kube-api-access-8wqvn major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/web-config/alertmanager/9 major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/web-config/config-reloader/6 major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~empty-dir/config-out major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~projected/kube-api-access-xlg2l:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~projected/kube-api-access-xlg2l major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~projected/tls-assets major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/config-volume major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/web-config major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/759c26ae-5372-442b-8752-61cea976fd25/volumes/kubernetes.io~projected/kube-api-access-kbj46:{mountpoint:/var/lib/kubelet/pods/759c26ae-5372-442b-8752-61cea976fd25/volumes/kubernetes.io~projected/kube-api-access-kbj46 major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/759c26ae-5372-442b-8752-61cea976fd25/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/759c26ae-5372-442b-8752-61cea976fd25/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7780d59b-2c7e-4662-89c8-4414580ee652/volumes/kubernetes.io~projected/kube-api-access-7455j:{mountpoint:/var/lib/kubelet/pods/7780d59b-2c7e-4662-89c8-4414580ee652/volumes/kubernetes.io~projected/kube-api-access-7455j major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~projected/kube-api-access-5r559:{mountpoint:/var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~projected/kube-api-access-5r559 major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:343 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:344 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~projected/kube-api-access-vrjhd:{mountpoint:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~projected/kube-api-access-vrjhd major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8950ff39-1eba-4849-a3fe-b351b2022c0e/volumes/kubernetes.io~projected/kube-api-access-hxb82:{mountpoint:/var/lib/kubelet/pods/8950ff39-1eba-4849-a3fe-b351b2022c0e/volumes/kubernetes.io~projected/kube-api-access-hxb82 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a7f110b-9d5e-43a1-832e-0066909fcb5e/volumes/kubernetes.io~projected/kube-api-access-rqkzc:{mountpoint:/var/lib/kubelet/pods/8a7f110b-9d5e-43a1-832e-0066909fcb5e/volumes/kubernetes.io~projected/kube-api-access-rqkzc major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a265f44c-4a61-4dae-a06d-55472c7bdf21/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/a265f44c-4a61-4dae-a06d-55472c7bdf21/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4f4c9d8-be23-48ea-a760-403fad2fa67b/volumes/kubernetes.io~projected/kube-api-access-gfqkn:{mountpoint:/var/lib/kubelet/pods/a4f4c9d8-be23-48ea-a760-403fad2fa67b/volumes/kubernetes.io~projected/kube-api-access-gfqkn major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b98854d2-7827-41a7-b636-5c7a95343ce5/volumes/kubernetes.io~projected/kube-api-access-vcmws:{mountpoint:/var/lib/kubelet/pods/b98854d2-7827-41a7-b636-5c7a95343ce5/volumes/kubernetes.io~projected/kube-api-access-vcmws major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b98854d2-7827-41a7-b636-5c7a95343ce5/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/b98854d2-7827-41a7-b636-5c7a95343ce5/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b98854d2-7827-41a7-b636-5c7a95343ce5/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/b98854d2-7827-41a7-b636-5c7a95343ce5/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:264 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bdc74bb7-9393-4f6a-b2d1-da324ea4f736/volumes/kubernetes.io~projected/kube-api-access-cfkqc:{mountpoint:/var/lib/kubelet/pods/bdc74bb7-9393-4f6a-b2d1-da324ea4f736/volumes/kubernetes.io~projected/kube-api-access-cfkqc major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f700ff69-3257-4068-8eb2-807a7b9f150b/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/f700ff69-3257-4068-8eb2-807a7b9f150b/volumes/kubernetes.io~secret/agent-certs major:0 minor:49 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/9f48b346191e48170a3e137da23f48d53fd544879a6fca8a1aa4b4001370a67f/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/037d4ff81f457b6ec6fd00328e2e22b5ec8dc96b71fb2ae3f51d70d400994a73/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/5bbda3818f985732f9bf8508ed78f8eae03c73ad604641152e9abf39bc67c877/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/e09e44af731f33c43208918fb0fc4a25d076fc30f9e7d61f49a0b64341a62118/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-107:{mountpoint:/var/lib/containers/storage/overlay/cb21f5489cbea68cd64c39c786d47fdff1c0c93694fe61636dbfc5c082293c50/merged major:0 minor:107 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/176c2701ab1bf35e1d090b58fa8a6d26713e945c594f459772f2a3f71fea9b63/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-122:{mountpoint:/var/lib/containers/storage/overlay/2b6bfd81349a8f4c5e8cafcbb93ce83c93f5fd3c2d175dbc484c15c3301a75f5/merged major:0 minor:122 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/7e3c6e51712191b5f7d6d442a9a147b6b7c5b82edcfd5a447cd9d41f32f59788/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/caf31f9606434f404ce283522d4fca5604280624bbecfcf19ec132e3b6b93397/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/cac1aeaa71e3fe8d2c0dd04687aab3ce2d8a296370f19cf6c9fbe9463bb52aef/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-141:{mountpoint:/var/lib/containers/storage/overlay/bfc7556dc260a25ee1c12c428e5b0468e5edb42b2b275351166fd27003dcc497/merged major:0 minor:141 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/92d9c6159cb683f104b81247b7c9a65721b79b26d9982399d11ce1514d0f6b1e/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/697044b3646c3fe80627ac4a9bfaefc96695636a87a3d4c096ff0bfdf2689b7d/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/b27f49049e81670dd764c123db28f014fc3bb638a119d8f265b15e24c5c88b5e/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/43c99df62ae600272cadbb1197af0d22b0dc4f83e7d6756d65449c2503fa1f97/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/99ac322124ed3bbb4095e974f3ba2a93d6c30155b0e6678932c68b3fd4581be3/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-169:{mountpoint:/var/lib/containers/storage/overlay/416e9959167cbb14bfea05b733001d77f8ef85629436c3cbeb353433843435e6/merged major:0 minor:169 fsType:overlay blockSize:0} overlay_0-176:{mountpoint:/var/lib/containers/storage/overlay/1b351551f5de1b32e7cb7a788d66e261409cdbe3f4d4e404bdbfe1923b5bba3a/merged major:0 minor:176 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/5c24663345a24256329f3475d710550a7fa5469e9121653715c8f5f667b90515/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/a63509826f8aaa5f8049131c04587e1296be7ad68576021271898b59b99b430a/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/07535e32007a995781768fe93e71f5733b1237ee89415e2b91b4b2f5fc2340ee/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/cd17feb32604f51248cb832c71bf0d2fb6e8f7550c9d7f05f705601ed4dc3f7b/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/4aedef10257977cc2d229a96963ebc9c2e52b6372d289869d8a2fd23d3dd6858/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/19204d1aa1c7af97d4f5b10927df917fe4be55b5d0d0c7b0b5bc92a5b0972763/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/e6ff6813ce345716b1d00fa63bf066047018ac070b2ccd105549c5d4237b3b13/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/d562646253c0f96080ea665685ea6c0bbcd361e8f3d7ef924e30a0b0a5831926/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/60c925c436df9f494b8697559896a8199c79f0164fc2ac2de07b011d39f03a9f/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/84585c17712f96e6055bb1b1656ceb617c55675ebf62ca1782f2c2efe3145862/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/6107719291c58c5d6ef0b71066b5ff04767a97693036048f57bc4eee4003a217/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/b17f2f5f888154bd0250862215183118b3722a7ae883da58bb6dc5fe18de94af/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/d4f543af4dd63587701056d2b0a7c4733f01785ec0c67f7098f38661ce4d5e4a/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-257:{mountpoint:/var/lib/containers/storage/overlay/dc6cc0b524a08205ae80ed1896359d74e5c82906e51f7187ed6e307b1cac882c/merged major:0 minor:257 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/4b88281ab0577e9c0175b2c9852d19822eb33c209e699240e3db4a64deed2e24/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/1d974ade215fd0e458ad0d281b58ac5c66cd16e6dbab74b11692371b55c0bf45/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/2f42a9d633c7cf844e5ad89d1f15cec07f3fad80bb8ae7e5856adaf02179b725/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-279:{mountpoint:/var/lib/containers/storage/overlay/f5efa568f55de92bddf4e7907909cdfd99e23a987b5c994f2755ea6921c89797/merged major:0 minor:279 fsType:overlay blockSize:0} overlay_0-285:{mountpoint:/var/lib/containers/storage/overlay/dda04636a725ebf14eb062762655ff88c8e3d521b5d496c0298ac0393e8e8f58/merged major:0 minor:285 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/3f1b15b6e1140e7a3fe5f7e4b32ccc8ca8fff32867fea90ad5a5196917c347a4/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/6447f8f5d6ec97685d8add2c66a6a6ead8a88d1f3f03fb82903d06915f346d9d/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/83be4a0ce9e2b8b3b8c510cdf79240613e284be7ccb9627d9ccabff8165f1380/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/ef296b0205e8696c5146777dcafadd7886e08a125cb0118c246eff8bbc8d5c13/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/dd9ad3187e835d604b4f7e66f77d24d18ffa1871af2373f98fca347e24b4f65d/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/8811c2a5324dbab36bbcc6baf1199d9c8d8e80e50191e1d29f51304dfe5c4a9e/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-341:{mountpoint:/var/lib/containers/storage/overlay/e5047698f9de14c5ba0562af3eb8d2c3c3747fbf964f2917e8498cb87b3e1f20/merged major:0 minor:341 fsType:overlay blockSize:0} overlay_0-349:{mountpoint:/var/lib/containers/storage/overlay/83f64cab83db3e9054aab0b2c8eca72961ab3c83e2b3488d5d673907a6b6db10/merged major:0 minor:349 fsType:overlay blockSize:0} overlay_0-351:{mountpoint:/var/lib/containers/storage/overlay/69db80ca40e4b10a7c48a97c826ee4c5b25c3586bc91617f43543f586b84ae22/merged major:0 minor:351 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/ba20ec083083edc85a62cc032e3c5d97a7ac1e353b4ebb4c6dd6d75900581f81/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/0fc6d427ef91cf74bc74042a042d2cb442d9bb8b74d4ae9fc2af4c7af3ff9b82/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/c1161af5c34b5d43bb15800164ff7f1e561d6e0607c978ce950e8227352f75c0/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/623e1cfccfcab9f7cda1a06aac90d1727f8e3c29d2216cff1993015fb38b083c/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/2b02c56d66d10a171fbc0ebc96a563d6c33f9130b5fa7d20c3ba0f0fb695b486/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/5571ec8830ad8fde09382b3e8ca2ce155b5974df19f774ffa72ab52d6d748981/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/76d4c22d9e730bd99f45daaf4173f378e4c9dcc37f8ae87eea54161e00a3bf37/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-391:{mountpoint:/var/lib/containers/storage/overlay/f87072f83a99a4ee17f9371200fef3813527026b62f7e92f17d6e2a0f675a55d/merged major:0 minor:391 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/40802bdbdcb17ae86fa3ea25ffa8f3b4aaf36893ff697cedc5a393f214017533/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-401:{mountpoint:/var/lib/containers/storage/overlay/1bb5748af79365ffe97d6aa411b09ed21c071024e227936b437e895de2ffffce/merged major:0 minor:401 fsType:overlay blockSize:0} overlay_0-406:{mountpoint:/var/lib/containers/storage/overlay/0842833f773dbb3af181fca3bcd474db2f27bd6f484aca6b2333424addca124c/merged major:0 minor:406 fsType:overlay blockSize:0} overlay_0-412:{mountpoint:/var/lib/containers/storage/overlay/0f294fc4dbbea81b56a108a80fb05005aa18783932ad4db14e9d2449224f2f49/merged major:0 minor:412 fsType:overlay blockSize:0} overlay_0-417:{mountpoint:/var/lib/containers/storage/overlay/a2351262fa56d4e2b3ab28e179cba040c2ce7530eee301ee3146f7d4817f031b/merged major:0 minor:417 fsType:overlay blockSize:0} overlay_0-422:{mountpoint:/var/lib/containers/storage/overlay/7affe5607f26464eb45a3dbb346d8bb640e609c035f31eb26d3b00dd62b3bffe/merged major:0 minor:422 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/812a816806dc01c4a54e16c946bfd98ae58282d607184ba6b1716e5793778cb8/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-432:{mountpoint:/var/lib/containers/storage/overlay/309f384d45e6e825e1e5c75e1968fe08815e717a629776a1e83b6a21ab7cd780/merged major:0 minor:432 fsType:overlay blockSize:0} overlay_0-67:{mountpoint:/var/lib/containers/storage/overlay/cd1d0ca77c550552093468a70a1549482fad68261aa930d1c33205bdcdcadaa0/merged major:0 minor:67 fsType:overlay blockSize:0} overlay_0-69:{mountpoint:/var/lib/containers/storage/overlay/b98bb2da8c2856bf8681b945d684445a8ae06240410ea2548e02b74d08059b43/merged major:0 minor:69 fsType:overlay blockSize:0} overlay_0-71:{mountpoint:/var/lib/containers/storage/overlay/6bec3bad233ab71abcbe56172bfc0ab25f547da9665927a9ad534e3dd957a4fc/merged major:0 minor:71 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/7c6ce42db91e2350050430d65c8cde4c1263d6eeaad5bc0aa5e4eb454dac63a9/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/aebc67b2f0d54c0c5708982008ed7127e1f4c0d3b938a72532a9e08ff6434c5a/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/3b127c51381c162f579429511c01fc28bc0ca4cfb492f389e4f9b7ee910a66de/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/044d21da73433f5a5b0a796ae79e0d60ada41d7b89a5842eba9d65dfdf28b2c5/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/635a9d33c7d217d91f503189ba3b239f8c788ee351d735fb8d56db6fd9eb7a9c/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/3322b15477741d556c5f0005c3fc696cf5d7a4d6fdcb2e5c4db6df666a21f832/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/0cd5762d202f4cbd26236b22ab1a33742db10c23e728466f5c307157f3b68dd3/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 04 01:35:10.588318 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.587635 5537 manager.go:217] Machine: {Timestamp:2026-11-04 01:35:10.586840827 +0000 UTC m=+0.059435111 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094800 MemoryCapacity:32812011520 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b66e8c07a8542a21293d42403d0f8 SystemUUID:ec2b66e8-c07a-8542-a212-93d42403d0f8 BootID:e90fbc49-6670-465e-ba71-6f3f62ddabe7 Filesystems:[{Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b98854d2-7827-41a7-b636-5c7a95343ce5/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:264 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:299 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c984ff65bb8f97f43bf87f9fbcac89885e299aa841e0b5f7e68c6ca49c5fb2d3/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-285 DeviceMajor:0 DeviceMinor:285 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:297 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:317 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:299 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-406 DeviceMajor:0 DeviceMinor:406 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b3668f558975076724138b078984c76886cfab99215c8c1ef767318aaee145d1/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-141 DeviceMajor:0 DeviceMinor:141 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:318 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/19603f03-3a29-404a-945e-7c489370a778/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:326 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b98854d2-7827-41a7-b636-5c7a95343ce5/volumes/kubernetes.io~projected/kube-api-access-vcmws DeviceMajor:0 DeviceMinor:265 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/41eb00308cef99316727394b04c9ad05d1d72370cd39a3688e18c6a2003a708b/userdata/shm DeviceMajor:0 DeviceMinor:266 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:296 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:299 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/a265f44c-4a61-4dae-a06d-55472c7bdf21/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:327 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/16dce250-b54a-40e2-a387-527df0330eb3/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fc287e8cbd33968059145dbcfd79aae31247e76e0ed5c5c6cc3a6de81cd3dd7f/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/3051e1d4-8634-414d-ab3e-6c970a0a5cac/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:244 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:299 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1080d3e1-b834-48f5-b2aa-28e01af0bff5/volumes/kubernetes.io~projected/kube-api-access-2pvrf DeviceMajor:0 DeviceMinor:55 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/759c26ae-5372-442b-8752-61cea976fd25/volumes/kubernetes.io~projected/kube-api-access-kbj46 DeviceMajor:0 DeviceMinor:203 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1d10983a595dacf6436093811c39c4782797a5bda1a3c4f99a868329d7351d2f/userdata/shm DeviceMajor:0 DeviceMinor:332 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-69 DeviceMajor:0 DeviceMinor:69 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-279 DeviceMajor:0 DeviceMinor:279 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:295 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/498926f5-18e3-4d4a-8c0c-51d889256af4/volumes/kubernetes.io~projected/kube-api-access-hhtdj DeviceMajor:0 DeviceMinor:334 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-391 DeviceMajor:0 DeviceMinor:391 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/64fb9e73ffe68da51d45b8972d91c13f839eafe11cae210b483fdc56a134f909/userdata/shm DeviceMajor:0 DeviceMinor:335 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/35fa75652d6ebe1c9daacc932fd1d55acf245056c8f3e09faf84653a0e464d67/userdata/shm DeviceMajor:0 DeviceMinor:66 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07394429-d52a-4e4f-bf9d-9b33be514f87/volumes/kubernetes.io~projected/kube-api-access-nwzh7 DeviceMajor:0 DeviceMinor:51 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/a4f4c9d8-be23-48ea-a760-403fad2fa67b/volumes/kubernetes.io~projected/kube-api-access-gfqkn DeviceMajor:0 DeviceMinor:52 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-176 DeviceMajor:0 DeviceMinor:176 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-67 DeviceMajor:0 DeviceMinor:67 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~projected/kube-api-access-xlg2l DeviceMajor:0 DeviceMinor:302 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0bcb691d9b6080022be5cd529b2ed50936699c38901c1cc925f9c5700879eb18/userdata/shm DeviceMajor:0 DeviceMinor:324 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fd86efd06ac4cd0192bb6bd60c931e398c24f0947aa7de4090e039379221f869/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0681cec5-c66c-49fc-9694-1dd49f6696e5/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:268 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:298 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-401 DeviceMajor:0 DeviceMinor:401 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7890e45aa0a903c13b3e78e544cd9f4b48fdf38a52d214154379654bb9323466/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/16dce250-b54a-40e2-a387-527df0330eb3/volumes/kubernetes.io~projected/kube-api-access-q5zjf DeviceMajor:0 DeviceMinor:202 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:300 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2b84eb6490db90410a1379b40813cfc7ceea5054f14fa03db2fc4100467ea2d1/userdata/shm DeviceMajor:0 DeviceMinor:303 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:316 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:312 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:345 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-122 DeviceMajor:0 DeviceMinor:122 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1080d3e1-b834-48f5-b2aa-28e01af0bff5/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:47 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-107 DeviceMajor:0 DeviceMinor:107 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/759c26ae-5372-442b-8752-61cea976fd25/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/26a5cb0e95819f513da6dae01a1b2b019546b91c299328f616c69863371acbd0/userdata/shm DeviceMajor:0 DeviceMinor:253 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/0681cec5-c66c-49fc-9694-1dd49f6696e5/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:269 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8a7f110b-9d5e-43a1-832e-0066909fcb5e/volumes/kubernetes.io~projected/kube-api-access-rqkzc DeviceMajor:0 DeviceMinor:58 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/19ca73d86de82b55f012fb3008c71a49c2b5b1082f26573ae4c897069446c66a/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:301 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:319 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/542f0dbb-ab95-4719-bcf2-6b0441d0feea/volumes/kubernetes.io~projected/kube-api-access-8wqvn DeviceMajor:0 DeviceMinor:53 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/7780d59b-2c7e-4662-89c8-4414580ee652/volumes/kubernetes.io~projected/kube-api-access-7455j DeviceMajor:0 DeviceMinor:57 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/626d88e085ac0160cb44307d5f6371aeafeae814a5517e5e9353633c30fd237a/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-169 DeviceMajor:0 DeviceMinor:169 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-341 DeviceMajor:0 DeviceMinor:341 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b98854d2-7827-41a7-b636-5c7a95343ce5/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:259 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-349 DeviceMajor:0 DeviceMinor:349 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e110f56948d18b5c9d8ad00b192bbd1b378022d38503d37af65304c72335c9ac/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-422 DeviceMajor:0 DeviceMinor:422 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07394429-d52a-4e4f-bf9d-9b33be514f87/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:48 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/0681cec5-c66c-49fc-9694-1dd49f6696e5/volumes/kubernetes.io~projected/kube-api-access-977vg DeviceMajor:0 DeviceMinor:270 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:344 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b887b9e7479eb1fb631874ef40e2adc7fbcb62c842e8ad6140166fbc271b8c53/userdata/shm DeviceMajor:0 DeviceMinor:62 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/1080d3e1-b834-48f5-b2aa-28e01af0bff5/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:290 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:343 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cdad6780c1d0a01eec120f8263fe33cb49bf1923d68a4d74ec6a865e29160e40/userdata/shm DeviceMajor:0 DeviceMinor:347 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/19603f03-3a29-404a-945e-7c489370a778/volumes/kubernetes.io~projected/kube-api-access-gjdw8 DeviceMajor:0 DeviceMinor:54 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1a4890fd-1ea5-4b53-9b71-b641ad07ad59/volumes/kubernetes.io~projected/kube-api-access-9xqrc DeviceMajor:0 DeviceMinor:204 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/702f2a38bbaab88979cb7e61fbcafe483a7cadf76533527c317a29f7b6105d67/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/3051e1d4-8634-414d-ab3e-6c970a0a5cac/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:243 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:294 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:320 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f700ff69-3257-4068-8eb2-807a7b9f150b/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:49 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/07394429-d52a-4e4f-bf9d-9b33be514f87/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:50 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/1a4890fd-1ea5-4b53-9b71-b641ad07ad59/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3051e1d4-8634-414d-ab3e-6c970a0a5cac/volumes/kubernetes.io~projected/kube-api-access-s7bvd DeviceMajor:0 DeviceMinor:252 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-412 DeviceMajor:0 DeviceMinor:412 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8950ff39-1eba-4849-a3fe-b351b2022c0e/volumes/kubernetes.io~projected/kube-api-access-hxb82 DeviceMajor:0 DeviceMinor:59 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-71 DeviceMajor:0 DeviceMinor:71 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:295 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/7d1eb32a-767f-4594-86f0-2e757881d769/volumes/kubernetes.io~projected/kube-api-access-5r559 DeviceMajor:0 DeviceMinor:346 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-417 DeviceMajor:0 DeviceMinor:417 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-432 DeviceMajor:0 DeviceMinor:432 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/78f30fc12ec012914109eefbc3ff29f7036bdb595750aa4820c54cf4df5f8923/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0417884e5936d24966ea3c9cd23534419703d2b485609309fae6d36cecb223d5/userdata/shm DeviceMajor:0 DeviceMinor:273 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3ad378d71597e667176d184c27b9207261aa638b878e825a5fe88edb6c27f913/userdata/shm DeviceMajor:0 DeviceMinor:330 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-257 DeviceMajor:0 DeviceMinor:257 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/82cb926a-b123-4eaf-88a7-f1c67e1ddf26/volumes/kubernetes.io~projected/kube-api-access-vrjhd DeviceMajor:0 DeviceMinor:321 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406003712 Type:vfs Inodes:4005372 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-351 DeviceMajor:0 DeviceMinor:351 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bdc74bb7-9393-4f6a-b2d1-da324ea4f736/volumes/kubernetes.io~projected/kube-api-access-cfkqc DeviceMajor:0 DeviceMinor:56 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/392da7767d47a216a91d6c6d8f07839eadb86247e82c34b1b4531e09c65328e9/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0bcb691d9b60800 MacAddress:be:7f:8f:36:a1:21 Speed:10000 Mtu:8901} {Name:1d10983a595dacf MacAddress:ae:ab:95:dd:5d:00 Speed:10000 Mtu:8901} {Name:26a5cb0e95819f5 MacAddress:3e:c4:72:d2:85:9f Speed:10000 Mtu:8901} {Name:2b84eb6490db904 MacAddress:92:48:c9:97:df:99 Speed:10000 Mtu:8901} {Name:3ad378d71597e66 MacAddress:3e:7f:23:44:32:74 Speed:10000 Mtu:8901} {Name:41eb00308cef993 MacAddress:4a:a5:54:da:3a:7b Speed:10000 Mtu:8901} {Name:64fb9e73ffe68da MacAddress:0e:82:0f:7f:b6:90 Speed:10000 Mtu:8901} {Name:702f2a38bbaab88 MacAddress:56:ab:2b:6f:e3:69 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:72:61:39:e1:6b Speed:0 Mtu:9001} {Name:br-int MacAddress:be:6e:41:ea:97:23 Speed:0 Mtu:8901} {Name:cdad6780c1d0a01 MacAddress:92:14:47:3e:d7:67 Speed:10000 Mtu:8901} {Name:e110f56948d18b5 MacAddress:ae:01:22:3b:69:30 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:72:61:39:e1:6b Speed:0 Mtu:9001} {Name:fc287e8cbd33968 MacAddress:6e:30:ed:f0:a2:f4 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:3e:08:e5:0b:98:79 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ba:26:64:55:86:3c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812011520 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 01:35:10.588578 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.588326 5537 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 01:35:10.588578 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.588382 5537 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 01:35:10.588675 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.588653 5537 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 01:35:10.588863 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.588676 5537 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-4.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 01:35:10.588863 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.588822 5537 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 01:35:10.588863 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.588831 5537 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 01:35:10.588863 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.588841 5537 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 01:35:10.588863 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.588861 5537 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 01:35:10.589013 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.588937 5537 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 01:35:10.589099 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.589089 5537 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 01:35:10.589203 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.589194 5537 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 01:35:10.589233 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.589230 5537 kubelet.go:493] "Attempting to sync node with API server" Nov 04 01:35:10.589278 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.589243 5537 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 01:35:10.589278 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.589254 5537 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 01:35:10.589278 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.589265 5537 kubelet.go:405] "Adding apiserver pod source" Nov 04 01:35:10.589278 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.589277 5537 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 01:35:10.589948 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.589933 5537 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 01:35:10.589948 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.589945 5537 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 01:35:10.590360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.590344 5537 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 01:35:10.592937 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.592922 5537 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 01:35:10.592937 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.592935 5537 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 01:35:10.593053 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593032 5537 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 04 01:35:10.593222 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593211 5537 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 01:35:10.593255 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593240 5537 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 01:35:10.593351 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593341 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 01:35:10.593386 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593355 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 01:35:10.593386 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593361 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 01:35:10.593386 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593367 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 01:35:10.593386 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593374 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 01:35:10.593386 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593383 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 01:35:10.593556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593399 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 01:35:10.593556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593406 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 01:35:10.593556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593413 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 01:35:10.593556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593419 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 01:35:10.593556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593431 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 01:35:10.593556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593440 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 01:35:10.593556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593467 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 01:35:10.593556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.593474 5537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 01:35:10.596970 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.596956 5537 server.go:1263] "Started kubelet" Nov 04 01:35:10.597174 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.597025 5537 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 01:35:10.597174 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.597084 5537 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 01:35:10.597313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.597160 5537 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 01:35:10.597453 ip-10-0-135-4 systemd[1]: Started Kubernetes Kubelet. Nov 04 01:35:10.597986 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.597965 5537 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 01:35:10.601563 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.600172 5537 server.go:317] "Adding debug handlers to kubelet server" Nov 04 01:35:10.602710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.602535 5537 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 01:35:10.602710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.602565 5537 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 01:35:10.602710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.602614 5537 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 01:35:10.602710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.602629 5537 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 01:35:10.602710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.602629 5537 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 01:28:59 +0000 UTC" deadline="2028-08-21 21:01:18.580095558 +0000 UTC" Nov 04 01:35:10.602710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.602669 5537 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15763h26m7.977430041s" Nov 04 01:35:10.602710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.602692 5537 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 01:35:10.603121 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:10.603046 5537 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-4.us-west-1.compute.internal\" not found" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.604963 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82cb926a-b123-4eaf-88a7-f1c67e1ddf26" volumeName="kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-grpc-tls" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605000 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b98854d2-7827-41a7-b636-5c7a95343ce5" volumeName="kubernetes.io/projected/b98854d2-7827-41a7-b636-5c7a95343ce5-kube-api-access-vcmws" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605018 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3051e1d4-8634-414d-ab3e-6c970a0a5cac" volumeName="kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-service-ca" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605032 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="498926f5-18e3-4d4a-8c0c-51d889256af4" volumeName="kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605037 5537 factory.go:55] Registering systemd factory Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605046 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d1eb32a-767f-4594-86f0-2e757881d769" volumeName="kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-metrics-server-audit-profiles" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605055 5537 factory.go:223] Registration of the systemd container factory successfully Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605059 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d1eb32a-767f-4594-86f0-2e757881d769" volumeName="kubernetes.io/empty-dir/7d1eb32a-767f-4594-86f0-2e757881d769-audit-log" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605071 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d1eb32a-767f-4594-86f0-2e757881d769" volumeName="kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-client-ca-bundle" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605082 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82cb926a-b123-4eaf-88a7-f1c67e1ddf26" volumeName="kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605100 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8950ff39-1eba-4849-a3fe-b351b2022c0e" volumeName="kubernetes.io/empty-dir/8950ff39-1eba-4849-a3fe-b351b2022c0e-tmp-dir" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605112 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b98854d2-7827-41a7-b636-5c7a95343ce5" volumeName="kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605126 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0681cec5-c66c-49fc-9694-1dd49f6696e5" volumeName="kubernetes.io/empty-dir/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-textfile" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605137 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0681cec5-c66c-49fc-9694-1dd49f6696e5" volumeName="kubernetes.io/projected/0681cec5-c66c-49fc-9694-1dd49f6696e5-kube-api-access-977vg" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605149 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16dce250-b54a-40e2-a387-527df0330eb3" volumeName="kubernetes.io/configmap/16dce250-b54a-40e2-a387-527df0330eb3-kube-rbac-proxy-cm" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605162 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3051e1d4-8634-414d-ab3e-6c970a0a5cac" volumeName="kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-serving-cert" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605179 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d1eb32a-767f-4594-86f0-2e757881d769" volumeName="kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-client-certs" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605193 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b98854d2-7827-41a7-b636-5c7a95343ce5" volumeName="kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-tls" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605204 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdc74bb7-9393-4f6a-b2d1-da324ea4f736" volumeName="kubernetes.io/configmap/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-iptables-alerter-script" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605215 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f700ff69-3257-4068-8eb2-807a7b9f150b" volumeName="kubernetes.io/secret/f700ff69-3257-4068-8eb2-807a7b9f150b-agent-certs" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605227 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16dce250-b54a-40e2-a387-527df0330eb3" volumeName="kubernetes.io/projected/16dce250-b54a-40e2-a387-527df0330eb3-kube-api-access-q5zjf" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605239 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16dce250-b54a-40e2-a387-527df0330eb3" volumeName="kubernetes.io/secret/16dce250-b54a-40e2-a387-527df0330eb3-insights-runtime-extractor-tls" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605254 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3051e1d4-8634-414d-ab3e-6c970a0a5cac" volumeName="kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-config" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605267 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3051e1d4-8634-414d-ab3e-6c970a0a5cac" volumeName="kubernetes.io/empty-dir/3051e1d4-8634-414d-ab3e-6c970a0a5cac-tmp" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605280 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605292 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605304 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82cb926a-b123-4eaf-88a7-f1c67e1ddf26" volumeName="kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-tls" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605317 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82cb926a-b123-4eaf-88a7-f1c67e1ddf26" volumeName="kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605330 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a4890fd-1ea5-4b53-9b71-b641ad07ad59" volumeName="kubernetes.io/projected/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-kube-api-access-9xqrc" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605343 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="759c26ae-5372-442b-8752-61cea976fd25" volumeName="kubernetes.io/configmap/759c26ae-5372-442b-8752-61cea976fd25-config-volume" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605359 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82cb926a-b123-4eaf-88a7-f1c67e1ddf26" volumeName="kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605372 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82cb926a-b123-4eaf-88a7-f1c67e1ddf26" volumeName="kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605394 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a265f44c-4a61-4dae-a06d-55472c7bdf21" volumeName="kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605407 5537 factory.go:153] Registering CRI-O factory Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605425 5537 factory.go:223] Registration of the crio container factory successfully Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605480 5537 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605499 5537 factory.go:103] Registering Raw factory Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605514 5537 manager.go:1199] Started watching for new ooms in manager Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605848 5537 manager.go:319] Starting recovery of all containers Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.605407 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4f4c9d8-be23-48ea-a760-403fad2fa67b" volumeName="kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-binary-copy" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606132 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdc74bb7-9393-4f6a-b2d1-da324ea4f736" volumeName="kubernetes.io/projected/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-kube-api-access-cfkqc" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606156 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3051e1d4-8634-414d-ab3e-6c970a0a5cac" volumeName="kubernetes.io/projected/3051e1d4-8634-414d-ab3e-6c970a0a5cac-kube-api-access-s7bvd" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606170 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3051e1d4-8634-414d-ab3e-6c970a0a5cac" volumeName="kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-oauth-config" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606183 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-metrics-client-ca" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606194 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-cluster-tls-config" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606208 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-web-config" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606222 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b98854d2-7827-41a7-b636-5c7a95343ce5" volumeName="kubernetes.io/configmap/b98854d2-7827-41a7-b636-5c7a95343ce5-metrics-client-ca" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606234 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-tls-assets" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606246 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-config-volume" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606259 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="759c26ae-5372-442b-8752-61cea976fd25" volumeName="kubernetes.io/empty-dir/759c26ae-5372-442b-8752-61cea976fd25-tmp-dir" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606271 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="759c26ae-5372-442b-8752-61cea976fd25" volumeName="kubernetes.io/projected/759c26ae-5372-442b-8752-61cea976fd25-kube-api-access-kbj46" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606317 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="19603f03-3a29-404a-945e-7c489370a778" volumeName="kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606331 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-main-db" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606343 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7780d59b-2c7e-4662-89c8-4414580ee652" volumeName="kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-cni-binary-copy" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606355 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7780d59b-2c7e-4662-89c8-4414580ee652" volumeName="kubernetes.io/projected/7780d59b-2c7e-4662-89c8-4414580ee652-kube-api-access-7455j" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606367 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a7f110b-9d5e-43a1-832e-0066909fcb5e" volumeName="kubernetes.io/projected/8a7f110b-9d5e-43a1-832e-0066909fcb5e-kube-api-access-rqkzc" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606379 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3051e1d4-8634-414d-ab3e-6c970a0a5cac" volumeName="kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-oauth-serving-cert" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606392 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8950ff39-1eba-4849-a3fe-b351b2022c0e" volumeName="kubernetes.io/projected/8950ff39-1eba-4849-a3fe-b351b2022c0e-kube-api-access-hxb82" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606408 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4f4c9d8-be23-48ea-a760-403fad2fa67b" volumeName="kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-sysctl-allowlist" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606420 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0681cec5-c66c-49fc-9694-1dd49f6696e5" volumeName="kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-accelerators-collector-config" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606435 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0681cec5-c66c-49fc-9694-1dd49f6696e5" volumeName="kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-tls" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606446 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0681cec5-c66c-49fc-9694-1dd49f6696e5" volumeName="kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606457 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16dce250-b54a-40e2-a387-527df0330eb3" volumeName="kubernetes.io/empty-dir/16dce250-b54a-40e2-a387-527df0330eb3-data-volume" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606468 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a4890fd-1ea5-4b53-9b71-b641ad07ad59" volumeName="kubernetes.io/secret/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-cert" seLinuxMountContext="" Nov 04 01:35:10.606439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606491 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-config-out" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606502 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-kube-api-access-xlg2l" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606512 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-main-tls" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606523 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07394429-d52a-4e4f-bf9d-9b33be514f87" volumeName="kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-tuned" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606534 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7780d59b-2c7e-4662-89c8-4414580ee652" volumeName="kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-multus-daemon-config" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606548 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82cb926a-b123-4eaf-88a7-f1c67e1ddf26" volumeName="kubernetes.io/configmap/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-metrics-client-ca" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606561 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4f4c9d8-be23-48ea-a760-403fad2fa67b" volumeName="kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606573 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1080d3e1-b834-48f5-b2aa-28e01af0bff5" volumeName="kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-config" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606584 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07394429-d52a-4e4f-bf9d-9b33be514f87" volumeName="kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-tmp" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606596 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07394429-d52a-4e4f-bf9d-9b33be514f87" volumeName="kubernetes.io/projected/07394429-d52a-4e4f-bf9d-9b33be514f87-kube-api-access-nwzh7" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606608 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606620 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1080d3e1-b834-48f5-b2aa-28e01af0bff5" volumeName="kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-script-lib" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606633 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="542f0dbb-ab95-4719-bcf2-6b0441d0feea" volumeName="kubernetes.io/projected/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kube-api-access-8wqvn" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606645 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d1eb32a-767f-4594-86f0-2e757881d769" volumeName="kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606657 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d1eb32a-767f-4594-86f0-2e757881d769" volumeName="kubernetes.io/projected/7d1eb32a-767f-4594-86f0-2e757881d769-kube-api-access-5r559" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606670 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a7f110b-9d5e-43a1-832e-0066909fcb5e" volumeName="kubernetes.io/configmap/8a7f110b-9d5e-43a1-832e-0066909fcb5e-serviceca" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606682 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1080d3e1-b834-48f5-b2aa-28e01af0bff5" volumeName="kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-env-overrides" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606693 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1080d3e1-b834-48f5-b2aa-28e01af0bff5" volumeName="kubernetes.io/projected/1080d3e1-b834-48f5-b2aa-28e01af0bff5-kube-api-access-2pvrf" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606706 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1080d3e1-b834-48f5-b2aa-28e01af0bff5" volumeName="kubernetes.io/secret/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovn-node-metrics-cert" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606717 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0681cec5-c66c-49fc-9694-1dd49f6696e5" volumeName="kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-metrics-client-ca" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606728 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="721fb020-df00-4a68-aca9-2b5083d413b1" volumeName="kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606740 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="759c26ae-5372-442b-8752-61cea976fd25" volumeName="kubernetes.io/secret/759c26ae-5372-442b-8752-61cea976fd25-metrics-tls" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606752 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82cb926a-b123-4eaf-88a7-f1c67e1ddf26" volumeName="kubernetes.io/projected/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-kube-api-access-vrjhd" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606763 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4f4c9d8-be23-48ea-a760-403fad2fa67b" volumeName="kubernetes.io/projected/a4f4c9d8-be23-48ea-a760-403fad2fa67b-kube-api-access-gfqkn" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606794 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="19603f03-3a29-404a-945e-7c489370a778" volumeName="kubernetes.io/projected/19603f03-3a29-404a-945e-7c489370a778-kube-api-access-gjdw8" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606808 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d1eb32a-767f-4594-86f0-2e757881d769" volumeName="kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-tls" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606820 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82cb926a-b123-4eaf-88a7-f1c67e1ddf26" volumeName="kubernetes.io/empty-dir/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-tmp" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606831 5537 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f700ff69-3257-4068-8eb2-807a7b9f150b" volumeName="kubernetes.io/configmap/f700ff69-3257-4068-8eb2-807a7b9f150b-konnectivity-ca" seLinuxMountContext="" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606842 5537 reconstruct.go:97] "Volume reconstruction finished" Nov 04 01:35:10.609443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.606849 5537 reconciler.go:29] "Reconciler: start to sync state" Nov 04 01:35:10.634412 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.634375 5537 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 01:35:10.636417 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.636391 5537 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 01:35:10.636570 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.636434 5537 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 01:35:10.636570 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.636455 5537 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 01:35:10.636570 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:10.636517 5537 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 04 01:35:10.654045 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.654007 5537 generic.go:356] "Generic (PLEG): container finished" podID="23c930d57aa7cd78fff74c7c1e987922" containerID="69f295c23c7be0f990b6828982885a6e8cd44801a842a322562651e6ea56cab2" exitCode=0 Nov 04 01:35:10.663009 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.662982 5537 generic.go:356] "Generic (PLEG): container finished" podID="0681cec5-c66c-49fc-9694-1dd49f6696e5" containerID="ab21e1c3dee51b8c2d974335a59f3a5ead5ef83490adddcfa77d0e9c8e98c873" exitCode=0 Nov 04 01:35:10.682594 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.682561 5537 generic.go:356] "Generic (PLEG): container finished" podID="721fb020-df00-4a68-aca9-2b5083d413b1" containerID="2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d" exitCode=0 Nov 04 01:35:10.689161 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.689125 5537 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="38b036e45aa608c39ecda320ee2431676a365d42f5a9226cc9a5289e39b8776f" exitCode=0 Nov 04 01:35:10.689161 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.689156 5537 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="af5bc25f281bfdd3df8417c364299780ea8d54dffbcc822131a472b661978dae" exitCode=0 Nov 04 01:35:10.689161 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.689166 5537 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="9511d461023fd146111b8b8165a99b7dc9308b3c58ffa1bf0860467d2876a743" exitCode=0 Nov 04 01:35:10.689350 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.689172 5537 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="4416f54724a598e722cfccd240a557c85c6949c38ec374eac7b017118a27765b" exitCode=0 Nov 04 01:35:10.689350 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.689178 5537 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="afe45968d881bf745badb39022fbfd0d5490c35d7c52569c56039e9235766464" exitCode=0 Nov 04 01:35:10.689350 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.689186 5537 generic.go:356] "Generic (PLEG): container finished" podID="a4f4c9d8-be23-48ea-a760-403fad2fa67b" containerID="81a5e4fab3065380bdf060220996e8c962ec1b3ac0ded0dcaaf65452946c4522" exitCode=0 Nov 04 01:35:10.703573 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:10.703542 5537 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-4.us-west-1.compute.internal\" not found" Nov 04 01:35:10.715169 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.715102 5537 manager.go:324] Recovery completed Nov 04 01:35:10.734759 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.734730 5537 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 01:35:10.736836 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:10.736804 5537 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 04 01:35:10.737827 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.737807 5537 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 01:35:10.737923 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.737840 5537 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 01:35:10.737923 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.737850 5537 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 01:35:10.740225 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740209 5537 cpu_manager.go:226] "Starting" policy="none" Nov 04 01:35:10.740225 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740223 5537 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 01:35:10.740225 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740225 5537 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 01:35:10.740360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740237 5537 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 01:35:10.740360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740351 5537 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 04 01:35:10.740436 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740361 5537 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 04 01:35:10.740436 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740386 5537 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 04 01:35:10.740436 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740392 5537 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 04 01:35:10.740436 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740397 5537 policy_none.go:50] "Start" Nov 04 01:35:10.740436 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740405 5537 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 01:35:10.740436 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740414 5537 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 01:35:10.740648 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740580 5537 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 04 01:35:10.740648 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740588 5537 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 04 01:35:10.740648 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.740594 5537 policy_none.go:44] "Start" Nov 04 01:35:10.741223 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.741208 5537 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 01:35:10.741284 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.741235 5537 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 01:35:10.741284 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.741245 5537 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 01:35:10.745392 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.745366 5537 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 01:35:10.748704 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.748693 5537 manager.go:341] "Starting Device Plugin manager" Nov 04 01:35:10.748762 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:10.748716 5537 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 01:35:10.748762 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.748724 5537 server.go:87] "Starting device plugin registration server" Nov 04 01:35:10.749006 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.748995 5537 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 01:35:10.749037 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.749007 5537 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 01:35:10.749135 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.749114 5537 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 01:35:10.749243 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.749214 5537 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 01:35:10.749295 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.749251 5537 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 01:35:10.749295 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.749258 5537 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 01:35:10.749428 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.749333 5537 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T01:35:10.749241526Z","UUID":"4c9f23a6-8551-4054-b7cc-e6e00cc0c78c","Handler":null,"Name":"","Endpoint":""} Nov 04 01:35:10.750903 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:10.750864 5537 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 01:35:10.751039 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:10.750908 5537 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-4.us-west-1.compute.internal\" not found" Nov 04 01:35:10.751039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.750939 5537 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 01:35:10.751039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.750963 5537 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 01:35:10.801163 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.801128 5537 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:35:10.801318 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.801304 5537 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 04 01:35:10.801817 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.801805 5537 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:35:10.802296 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.802283 5537 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:35:10.849566 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.849543 5537 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 01:35:10.850587 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.850567 5537 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 01:35:10.850723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.850600 5537 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 01:35:10.850723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.850611 5537 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-4.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 01:35:10.850723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.850663 5537 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:10.899646 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.899613 5537 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 01:35:10.937891 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.937840 5537 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal"] Nov 04 01:35:10.938408 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.938377 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" event={"ID":"c9d6b8a5b75c98b7e9c979c9bafacea9","Type":"ContainerStarted","Data":"0df092ae4659e96a32f29000fbbf91fd9acf317f769657a87a85f1bc221d0b9d"} Nov 04 01:35:10.938469 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.938414 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" event={"ID":"c9d6b8a5b75c98b7e9c979c9bafacea9","Type":"ContainerStarted","Data":"b887b9e7479eb1fb631874ef40e2adc7fbcb62c842e8ad6140166fbc271b8c53"} Nov 04 01:35:10.938469 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.938432 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" event={"ID":"23c930d57aa7cd78fff74c7c1e987922","Type":"ContainerStarted","Data":"287e9f0bea3e1c1b865d1f53bd3c862fc4d5a3799526a5fde7a09950b5313dd0"} Nov 04 01:35:10.938469 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.938450 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" event={"ID":"23c930d57aa7cd78fff74c7c1e987922","Type":"ContainerDied","Data":"69f295c23c7be0f990b6828982885a6e8cd44801a842a322562651e6ea56cab2"} Nov 04 01:35:10.938469 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.938464 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" event={"ID":"23c930d57aa7cd78fff74c7c1e987922","Type":"ContainerStarted","Data":"b3668f558975076724138b078984c76886cfab99215c8c1ef767318aaee145d1"} Nov 04 01:35:10.938651 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.938488 5537 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:10.938701 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.938666 5537 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:10.959186 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.959158 5537 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:10.959303 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:10.959229 5537 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.000876 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.000854 5537 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 01:35:11.000980 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:11.000900 5537 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.001532 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.001514 5537 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 01:35:11.001628 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:11.001551 5537 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.103022 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.102981 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.103022 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.103017 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9d6b8a5b75c98b7e9c979c9bafacea9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"c9d6b8a5b75c98b7e9c979c9bafacea9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.103207 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.103038 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.203196 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.203153 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9d6b8a5b75c98b7e9c979c9bafacea9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"c9d6b8a5b75c98b7e9c979c9bafacea9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.203196 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.203194 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.203404 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.203211 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.203404 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.203241 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9d6b8a5b75c98b7e9c979c9bafacea9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"c9d6b8a5b75c98b7e9c979c9bafacea9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.203404 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.203270 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.203404 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.203248 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23c930d57aa7cd78fff74c7c1e987922-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" (UID: \"23c930d57aa7cd78fff74c7c1e987922\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.590409 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.590380 5537 apiserver.go:52] "Watching apiserver" Nov 04 01:35:11.694497 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.694464 5537 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 01:35:11.695327 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.695298 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-844bd489c5-9phdj","openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl","openshift-multus/multus-additional-cni-plugins-g7rmq","kube-system/global-pull-secret-syncer-rghpj","openshift-cluster-node-tuning-operator/tuned-h46h5","openshift-ingress-canary/ingress-canary-zcqh2","openshift-dns/node-resolver-7dt2n","openshift-ovn-kubernetes/ovnkube-node-k9jb7","kube-system/konnectivity-agent-c55hv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg","openshift-monitoring/node-exporter-76zqz","openshift-insights/insights-runtime-extractor-dzv4w","openshift-monitoring/alertmanager-main-0","openshift-multus/multus-9nnr8","openshift-monitoring/thanos-querier-b944f9c8b-bcwpk","openshift-multus/network-metrics-daemon-2kbxl","openshift-console/console-56f8696d4d-cjpdx","kube-system/kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal","openshift-dns/dns-default-4m5nq","openshift-image-registry/node-ca-klpkr","openshift-network-operator/iptables-alerter-snwbg","openshift-network-diagnostics/network-check-target-nwps2"] Nov 04 01:35:11.698801 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.698754 5537 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.705468 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.705419 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-kubernetes\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.705608 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.705492 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/759c26ae-5372-442b-8752-61cea976fd25-metrics-tls\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:35:11.705845 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.705819 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbj46\" (UniqueName: \"kubernetes.io/projected/759c26ae-5372-442b-8752-61cea976fd25-kube-api-access-kbj46\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:35:11.705913 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.705864 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-oauth-config\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.705913 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.705889 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:11.706003 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.705916 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysconfig\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.706003 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.705938 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-host\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.706003 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.705961 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759c26ae-5372-442b-8752-61cea976fd25-tmp-dir\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:35:11.706149 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706004 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-serving-cert\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.706149 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706051 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-kubelet-config\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:11.706149 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706071 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759c26ae-5372-442b-8752-61cea976fd25-tmp-dir\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:35:11.706149 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706075 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-var-lib-kubelet\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.706149 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706105 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xqrc\" (UniqueName: \"kubernetes.io/projected/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-kube-api-access-9xqrc\") pod \"ingress-canary-zcqh2\" (UID: \"1a4890fd-1ea5-4b53-9b71-b641ad07ad59\") " pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:35:11.706429 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706230 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16dce250-b54a-40e2-a387-527df0330eb3-crio-socket\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.706429 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706258 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwzh7\" (UniqueName: \"kubernetes.io/projected/07394429-d52a-4e4f-bf9d-9b33be514f87-kube-api-access-nwzh7\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.706429 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706287 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5zjf\" (UniqueName: \"kubernetes.io/projected/16dce250-b54a-40e2-a387-527df0330eb3-kube-api-access-q5zjf\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.706429 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706403 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-dbus\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:11.706614 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706535 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-modprobe-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.706614 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706559 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-lib-modules\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.706614 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706579 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-tmp\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.706752 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706659 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-tmp\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.706752 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706692 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16dce250-b54a-40e2-a387-527df0330eb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.706752 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706739 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16dce250-b54a-40e2-a387-527df0330eb3-data-volume\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.706903 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706808 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16dce250-b54a-40e2-a387-527df0330eb3-data-volume\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.706903 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706829 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-run\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.706903 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706875 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-conf\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.707064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706907 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-systemd\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.707064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.706944 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-tuned\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.707064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.707021 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-tuned\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.707064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.707035 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.707064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.707062 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-cert\") pod \"ingress-canary-zcqh2\" (UID: \"1a4890fd-1ea5-4b53-9b71-b641ad07ad59\") " pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:35:11.707291 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.707078 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/759c26ae-5372-442b-8752-61cea976fd25-config-volume\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:35:11.707376 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.707318 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16dce250-b54a-40e2-a387-527df0330eb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.707376 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.707347 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-sys\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.748661 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.748625 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5jndn\"" Nov 04 01:35:11.749180 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.749065 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 01:35:11.749180 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.749135 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.749180 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.749135 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 01:35:11.749357 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.749198 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xwn9r\"" Nov 04 01:35:11.749357 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.749224 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.749357 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.749254 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 01:35:11.749357 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.749263 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.750036 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.749969 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.750036 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.749987 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.750036 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750028 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.750208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750057 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 01:35:11.750208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750100 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.750208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750117 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lhd4j\"" Nov 04 01:35:11.750208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750125 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tfqdd\"" Nov 04 01:35:11.750208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750127 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.750208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750171 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-ldpmc\"" Nov 04 01:35:11.750414 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750303 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 01:35:11.750414 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750377 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 01:35:11.750940 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750923 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.750940 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.750930 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.751139 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751126 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-sj5vk\"" Nov 04 01:35:11.751139 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751134 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 01:35:11.751218 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751176 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zbbgd\"" Nov 04 01:35:11.751218 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751180 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-shfxh\"" Nov 04 01:35:11.751218 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751207 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ctj2f\"" Nov 04 01:35:11.751686 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751652 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mh5l6\"" Nov 04 01:35:11.751686 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751660 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 01:35:11.751862 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751844 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 01:35:11.751923 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751844 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.751923 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751849 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 01:35:11.752034 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751928 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vr5s4\"" Nov 04 01:35:11.752034 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.751939 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 01:35:11.752119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.752042 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.752119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.752054 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.752119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.752063 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 01:35:11.752119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.752089 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.752119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.752111 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-vqsf7\"" Nov 04 01:35:11.752320 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.752120 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 01:35:11.752438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.752422 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.757433 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.757407 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a265f44c-4a61-4dae-a06d-55472c7bdf21-original-pull-secret\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:11.758287 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.758269 5537 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 01:35:11.758370 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:11.758328 5537 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-4.us-west-1.compute.internal" Nov 04 01:35:11.793645 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.793617 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 01:35:11.794219 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.794197 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.794479 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.794458 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 01:35:11.794563 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.794466 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.794876 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.794861 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkhwh\"" Nov 04 01:35:11.795126 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.795114 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 01:35:11.795185 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.795169 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2jjdl\"" Nov 04 01:35:11.795335 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.795324 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 01:35:11.795404 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.795391 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j6ln8\"" Nov 04 01:35:11.795444 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.795393 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gnb5c\"" Nov 04 01:35:11.797740 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.797721 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-cert\") pod \"ingress-canary-zcqh2\" (UID: \"1a4890fd-1ea5-4b53-9b71-b641ad07ad59\") " pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:35:11.797818 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.797721 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16dce250-b54a-40e2-a387-527df0330eb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.798181 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.798165 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.804203 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.804182 5537 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 01:35:11.805835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.805818 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbj46\" (UniqueName: \"kubernetes.io/projected/759c26ae-5372-442b-8752-61cea976fd25-kube-api-access-kbj46\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:35:11.805975 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.805958 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xqrc\" (UniqueName: \"kubernetes.io/projected/1a4890fd-1ea5-4b53-9b71-b641ad07ad59-kube-api-access-9xqrc\") pod \"ingress-canary-zcqh2\" (UID: \"1a4890fd-1ea5-4b53-9b71-b641ad07ad59\") " pod="openshift-ingress-canary/ingress-canary-zcqh2" Nov 04 01:35:11.807274 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.807254 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwzh7\" (UniqueName: \"kubernetes.io/projected/07394429-d52a-4e4f-bf9d-9b33be514f87-kube-api-access-nwzh7\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.808215 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808187 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98854d2-7827-41a7-b636-5c7a95343ce5-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:35:11.808284 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808227 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16dce250-b54a-40e2-a387-527df0330eb3-crio-socket\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.808317 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808300 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16dce250-b54a-40e2-a387-527df0330eb3-crio-socket\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.808346 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808307 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-conf-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.808376 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808349 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-metrics-client-ca\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.808451 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808432 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8950ff39-1eba-4849-a3fe-b351b2022c0e-tmp-dir\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:35:11.808497 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808485 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqkn\" (UniqueName: \"kubernetes.io/projected/a4f4c9d8-be23-48ea-a760-403fad2fa67b-kube-api-access-gfqkn\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.808527 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808506 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-cnibin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.808527 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808508 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8950ff39-1eba-4849-a3fe-b351b2022c0e-tmp-dir\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:35:11.808527 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808520 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-netd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.808652 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808536 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-modprobe-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.808652 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808557 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-var-lib-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.808652 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808637 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cnibin\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.808762 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808690 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.808762 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808698 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-modprobe-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.808762 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808747 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjdw8\" (UniqueName: \"kubernetes.io/projected/19603f03-3a29-404a-945e-7c489370a778-kube-api-access-gjdw8\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:35:11.808879 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808823 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.808879 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808855 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-textfile\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.808938 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808881 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-kubelet\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.808938 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.808926 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-config\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.809028 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809008 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.809028 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809019 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-textfile\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.809096 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809079 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.809142 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809113 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlg2l\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-kube-api-access-xlg2l\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.809142 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809136 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.809225 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809186 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7455j\" (UniqueName: \"kubernetes.io/projected/7780d59b-2c7e-4662-89c8-4414580ee652-kube-api-access-7455j\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.809256 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809236 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqkzc\" (UniqueName: \"kubernetes.io/projected/8a7f110b-9d5e-43a1-832e-0066909fcb5e-kube-api-access-rqkzc\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:35:11.809285 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809254 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:35:11.809285 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809277 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.809399 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809295 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-client-ca-bundle\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.809399 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809313 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f700ff69-3257-4068-8eb2-807a7b9f150b-konnectivity-ca\") pod \"konnectivity-agent-c55hv\" (UID: \"f700ff69-3257-4068-8eb2-807a7b9f150b\") " pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:35:11.809399 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809341 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-systemd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.809399 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809370 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-etc-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.809539 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809405 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.809539 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809529 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.809597 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809536 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19603f03-3a29-404a-945e-7c489370a778-metrics-certs\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:35:11.809597 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809573 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r559\" (UniqueName: \"kubernetes.io/projected/7d1eb32a-767f-4594-86f0-2e757881d769-kube-api-access-5r559\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.809650 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809596 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:35:11.809650 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809614 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-k8s-cni-cncf-io\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.809650 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809632 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-device-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.809733 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809648 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.809733 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809667 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-dbus\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:11.809733 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809676 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f700ff69-3257-4068-8eb2-807a7b9f150b-konnectivity-ca\") pod \"konnectivity-agent-c55hv\" (UID: \"f700ff69-3257-4068-8eb2-807a7b9f150b\") " pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:35:11.809733 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809681 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-lib-modules\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.809889 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809732 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-tls\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.809889 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809760 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-lib-modules\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.809889 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809759 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-977vg\" (UniqueName: \"kubernetes.io/projected/0681cec5-c66c-49fc-9694-1dd49f6696e5-kube-api-access-977vg\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.809889 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809807 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-node-log\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.809889 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809826 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pvrf\" (UniqueName: \"kubernetes.io/projected/1080d3e1-b834-48f5-b2aa-28e01af0bff5-kube-api-access-2pvrf\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.809889 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809842 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxb82\" (UniqueName: \"kubernetes.io/projected/8950ff39-1eba-4849-a3fe-b351b2022c0e-kube-api-access-hxb82\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:35:11.809889 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809864 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-run\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.809889 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809880 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-etc-selinux\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.810107 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809895 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-sys\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.810107 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809901 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-dbus\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:11.810107 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809908 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a7f110b-9d5e-43a1-832e-0066909fcb5e-host\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:35:11.810107 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.809940 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfkqc\" (UniqueName: \"kubernetes.io/projected/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-kube-api-access-cfkqc\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:35:11.810107 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810012 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-run\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.810278 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810197 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-multus-certs\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.810278 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810225 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-registration-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.810278 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810274 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.810386 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810297 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-sys\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.810386 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810354 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-sys\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.810455 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810390 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-kubernetes\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.810455 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810411 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.810455 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810426 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-bin\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.810455 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810445 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.810584 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810491 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-tls\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.810584 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810526 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-kubernetes\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.810584 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810524 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-netns\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.810584 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810568 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-log-socket\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.810754 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810639 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.810754 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810694 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7bvd\" (UniqueName: \"kubernetes.io/projected/3051e1d4-8634-414d-ab3e-6c970a0a5cac-kube-api-access-s7bvd\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.810754 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810740 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovn-node-metrics-cert\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.810862 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810798 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-system-cni-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.810862 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810825 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.810949 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810892 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:35:11.810949 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.810912 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.811052 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811025 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-metrics-server-audit-profiles\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.811108 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811052 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-var-lib-kubelet\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.811108 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811074 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-service-ca\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.811108 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811097 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-hostroot\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.811232 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811158 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovn-node-metrics-cert\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.811232 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811176 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-sys-fs\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.811232 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811194 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-systemd-units\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.811232 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811209 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-ovn\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.811232 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811225 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-env-overrides\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.811389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811240 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-tmp\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.811389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811257 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.811389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811274 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrjhd\" (UniqueName: \"kubernetes.io/projected/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-kube-api-access-vrjhd\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.811471 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811402 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-oauth-serving-cert\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.811471 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811421 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-host-slash\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:35:11.811471 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811439 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.811471 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811455 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d1eb32a-767f-4594-86f0-2e757881d769-audit-log\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.811471 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811470 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-conf\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.811600 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811485 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-systemd\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.811600 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811420 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.811600 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811553 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f700ff69-3257-4068-8eb2-807a7b9f150b-agent-certs\") pod \"konnectivity-agent-c55hv\" (UID: \"f700ff69-3257-4068-8eb2-807a7b9f150b\") " pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:35:11.811600 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811570 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-socket-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.811710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811608 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.811710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811625 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.811710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811643 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-iptables-alerter-script\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:35:11.811710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811659 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.811710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811666 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-env-overrides\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.811710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811675 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-wtmp\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.811890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811710 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-tmp\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.811890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811714 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-systemd\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.811948 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811889 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f700ff69-3257-4068-8eb2-807a7b9f150b-agent-certs\") pod \"konnectivity-agent-c55hv\" (UID: \"f700ff69-3257-4068-8eb2-807a7b9f150b\") " pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:35:11.811948 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811925 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-var-lib-kubelet\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.811948 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811939 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-iptables-alerter-script\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:35:11.812026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.811982 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-kubelet\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.812026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812000 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.812026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812019 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.812107 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812027 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d1eb32a-767f-4594-86f0-2e757881d769-audit-log\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.812107 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812053 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.812107 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812070 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-grpc-tls\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.812107 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812085 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-slash\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.812107 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812103 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmws\" (UniqueName: \"kubernetes.io/projected/b98854d2-7827-41a7-b636-5c7a95343ce5-kube-api-access-vcmws\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:35:11.812234 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812117 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-conf\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.812234 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812119 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.812234 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812156 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-client-certs\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.812234 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812172 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-host\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.812234 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812216 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3051e1d4-8634-414d-ab3e-6c970a0a5cac-tmp\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.812362 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812236 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-tls\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.812362 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812253 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-kubelet-config\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:11.812362 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812271 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-socket-dir-parent\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.812362 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812316 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3051e1d4-8634-414d-ab3e-6c970a0a5cac-tmp\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.812362 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812344 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-host\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.812494 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812434 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-multus-daemon-config\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.812494 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812463 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-config-out\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.812494 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812482 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a265f44c-4a61-4dae-a06d-55472c7bdf21-kubelet-config\") pod \"global-pull-secret-syncer-rghpj\" (UID: \"a265f44c-4a61-4dae-a06d-55472c7bdf21\") " pod="kube-system/global-pull-secret-syncer-rghpj" Nov 04 01:35:11.812575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812514 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.812575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812556 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-config-out\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.812632 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812615 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a7f110b-9d5e-43a1-832e-0066909fcb5e-serviceca\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:35:11.812768 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812740 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-root\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.812880 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812840 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.812880 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812868 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-multus-daemon-config\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.813056 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812937 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.813056 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.812977 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.813056 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813009 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-bin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.813056 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813037 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-multus\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.813244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813064 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-netns\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.813244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813130 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-system-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.813244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813180 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysctl-d\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.813244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813182 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-cni-binary-copy\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.813244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813224 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a7f110b-9d5e-43a1-832e-0066909fcb5e-serviceca\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:35:11.813410 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813279 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wqvn\" (UniqueName: \"kubernetes.io/projected/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kube-api-access-8wqvn\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.813410 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813333 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.813410 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813366 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7780d59b-2c7e-4662-89c8-4414580ee652-cni-binary-copy\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.813552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813438 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:35:11.813552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813486 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-config\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.813646 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813591 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f4c9d8-be23-48ea-a760-403fad2fa67b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.813693 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813654 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-web-config\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.813739 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813689 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-metrics-client-ca\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.813801 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813740 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysconfig\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.813846 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813770 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-etc-kubernetes\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.813846 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813834 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-script-lib\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.814104 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.813890 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8950ff39-1eba-4849-a3fe-b351b2022c0e-hosts-file\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:35:11.814176 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.814126 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-script-lib\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.814270 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.814249 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1080d3e1-b834-48f5-b2aa-28e01af0bff5-ovnkube-config\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.814349 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.814279 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07394429-d52a-4e4f-bf9d-9b33be514f87-etc-sysconfig\") pod \"tuned-h46h5\" (UID: \"07394429-d52a-4e4f-bf9d-9b33be514f87\") " pod="openshift-cluster-node-tuning-operator/tuned-h46h5" Nov 04 01:35:11.849896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849296 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.849896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849311 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.849896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849497 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 04 01:35:11.849896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849544 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.849896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849566 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Nov 04 01:35:11.849896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849577 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 04 01:35:11.849896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849584 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 04 01:35:11.849896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849612 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 04 01:35:11.849896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849632 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 04 01:35:11.849896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849852 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849915 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849928 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849970 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850053 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.849981 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850000 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850010 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850010 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850019 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-foa7uv69k5mn3\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850050 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850058 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850080 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850130 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850148 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vs9fm\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850159 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850192 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850206 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850211 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850250 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850275 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gpnv2\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850290 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bnxvr\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850301 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850332 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850362 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850393 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 04 01:35:11.850438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850408 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850497 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850522 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n7sx9\"" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850556 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8q64n\"" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850571 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850587 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850603 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850624 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850632 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850695 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850862 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-tls\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.851353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.850929 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-84fqpgig3nv4s\"" Nov 04 01:35:11.851936 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.851665 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 04 01:35:11.851936 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.851847 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-metrics-server-audit-profiles\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.852037 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.851959 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1eb32a-767f-4594-86f0-2e757881d769-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.852084 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852036 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:35:11.852156 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852137 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.852203 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852150 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-oauth-serving-cert\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.852203 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852189 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.852407 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852390 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-service-ca\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.852510 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852489 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.852576 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852560 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.852717 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852699 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.852768 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852730 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.852965 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852948 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-tls\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.853014 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.852966 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-grpc-tls\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.853147 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.853128 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-secret-metrics-server-client-certs\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.853196 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.853134 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.853275 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.853258 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.853335 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.853319 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.857188 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.857145 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-web-config\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.857188 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.857150 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16dce250-b54a-40e2-a387-527df0330eb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.857347 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.857168 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/759c26ae-5372-442b-8752-61cea976fd25-metrics-tls\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:35:11.857686 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.857630 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-serving-cert\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.857764 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.857188 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-oauth-config\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.857764 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.857150 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-metrics-client-ca\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.857886 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.857821 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/759c26ae-5372-442b-8752-61cea976fd25-config-volume\") pod \"dns-default-4m5nq\" (UID: \"759c26ae-5372-442b-8752-61cea976fd25\") " pod="openshift-dns/dns-default-4m5nq" Nov 04 01:35:11.858009 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.857984 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5zjf\" (UniqueName: \"kubernetes.io/projected/16dce250-b54a-40e2-a387-527df0330eb3-kube-api-access-q5zjf\") pod \"insights-runtime-extractor-dzv4w\" (UID: \"16dce250-b54a-40e2-a387-527df0330eb3\") " pod="openshift-insights/insights-runtime-extractor-dzv4w" Nov 04 01:35:11.858531 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.858508 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98854d2-7827-41a7-b636-5c7a95343ce5-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:35:11.858616 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.858599 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-metrics-client-ca\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.860146 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.859964 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.860146 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.860011 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.860146 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.860030 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.860146 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.860117 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-config\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.860146 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.860121 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98854d2-7827-41a7-b636-5c7a95343ce5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:35:11.860146 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.860143 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.860458 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.860174 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d1eb32a-767f-4594-86f0-2e757881d769-client-ca-bundle\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.860458 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.860287 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-tls\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.868373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.867891 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqkn\" (UniqueName: \"kubernetes.io/projected/a4f4c9d8-be23-48ea-a760-403fad2fa67b-kube-api-access-gfqkn\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.868373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.868204 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqkzc\" (UniqueName: \"kubernetes.io/projected/8a7f110b-9d5e-43a1-832e-0066909fcb5e-kube-api-access-rqkzc\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:35:11.868527 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.868495 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjdw8\" (UniqueName: \"kubernetes.io/projected/19603f03-3a29-404a-945e-7c489370a778-kube-api-access-gjdw8\") pod \"network-metrics-daemon-2kbxl\" (UID: \"19603f03-3a29-404a-945e-7c489370a778\") " pod="openshift-multus/network-metrics-daemon-2kbxl" Nov 04 01:35:11.868795 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.868590 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlg2l\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-kube-api-access-xlg2l\") pod \"alertmanager-main-0\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:11.868795 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.868736 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7455j\" (UniqueName: \"kubernetes.io/projected/7780d59b-2c7e-4662-89c8-4414580ee652-kube-api-access-7455j\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.868795 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.868746 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r559\" (UniqueName: \"kubernetes.io/projected/7d1eb32a-767f-4594-86f0-2e757881d769-kube-api-access-5r559\") pod \"metrics-server-844bd489c5-9phdj\" (UID: \"7d1eb32a-767f-4594-86f0-2e757881d769\") " pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:11.868919 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.868863 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfkqc\" (UniqueName: \"kubernetes.io/projected/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-kube-api-access-cfkqc\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:35:11.868919 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.868907 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxb82\" (UniqueName: \"kubernetes.io/projected/8950ff39-1eba-4849-a3fe-b351b2022c0e-kube-api-access-hxb82\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:35:11.868973 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.868909 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-977vg\" (UniqueName: \"kubernetes.io/projected/0681cec5-c66c-49fc-9694-1dd49f6696e5-kube-api-access-977vg\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.869006 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.868979 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pvrf\" (UniqueName: \"kubernetes.io/projected/1080d3e1-b834-48f5-b2aa-28e01af0bff5-kube-api-access-2pvrf\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.869132 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.869116 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7bvd\" (UniqueName: \"kubernetes.io/projected/3051e1d4-8634-414d-ab3e-6c970a0a5cac-kube-api-access-s7bvd\") pod \"console-56f8696d4d-cjpdx\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:11.870039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.870012 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrjhd\" (UniqueName: \"kubernetes.io/projected/82cb926a-b123-4eaf-88a7-f1c67e1ddf26-kube-api-access-vrjhd\") pod \"thanos-querier-b944f9c8b-bcwpk\" (UID: \"82cb926a-b123-4eaf-88a7-f1c67e1ddf26\") " pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:11.885065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.885038 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmws\" (UniqueName: \"kubernetes.io/projected/b98854d2-7827-41a7-b636-5c7a95343ce5-kube-api-access-vcmws\") pod \"openshift-state-metrics-7bd7489957-chzpl\" (UID: \"b98854d2-7827-41a7-b636-5c7a95343ce5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-chzpl" Nov 04 01:35:11.885324 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.885307 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wqvn\" (UniqueName: \"kubernetes.io/projected/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kube-api-access-8wqvn\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.885422 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.885405 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhtdj\" (UniqueName: \"kubernetes.io/projected/498926f5-18e3-4d4a-8c0c-51d889256af4-kube-api-access-hhtdj\") pod \"network-check-target-nwps2\" (UID: \"498926f5-18e3-4d4a-8c0c-51d889256af4\") " pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:35:11.914417 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914381 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-conf-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.914558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914430 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-cnibin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.914558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914455 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-netd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.914558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914480 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-var-lib-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.914558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914510 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-netd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.914558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914480 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-conf-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.914558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914504 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cnibin\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.914558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914549 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-cnibin\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914550 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-var-lib-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914573 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914598 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-kubelet\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914599 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-cnibin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914632 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914648 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914660 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-systemd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914684 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-etc-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914694 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-systemd\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914652 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-kubelet\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914708 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914711 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-k8s-cni-cncf-io\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914740 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-k8s-cni-cncf-io\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914748 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-device-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914749 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-etc-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914796 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-node-log\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914806 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-device-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914826 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-node-log\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914831 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-etc-selinux\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914858 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-sys\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914862 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-etc-selinux\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914888 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a7f110b-9d5e-43a1-832e-0066909fcb5e-host\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914909 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-sys\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914914 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-multus-certs\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914933 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a7f110b-9d5e-43a1-832e-0066909fcb5e-host\") pod \"node-ca-klpkr\" (UID: \"8a7f110b-9d5e-43a1-832e-0066909fcb5e\") " pod="openshift-image-registry/node-ca-klpkr" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914939 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-registration-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914962 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-multus-certs\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.914966 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915003 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-bin\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.915000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915008 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-registration-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915027 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-netns\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915035 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915051 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-log-socket\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915059 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-cni-bin\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915077 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-system-cni-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915093 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-run-netns\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915098 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-log-socket\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915106 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-hostroot\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915126 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f4c9d8-be23-48ea-a760-403fad2fa67b-system-cni-dir\") pod \"multus-additional-cni-plugins-g7rmq\" (UID: \"a4f4c9d8-be23-48ea-a760-403fad2fa67b\") " pod="openshift-multus/multus-additional-cni-plugins-g7rmq" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915128 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-sys-fs\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915151 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-hostroot\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915151 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-systemd-units\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915173 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-ovn\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915190 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-sys-fs\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915199 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-systemd-units\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915202 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-host-slash\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915227 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-ovn\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915236 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdc74bb7-9393-4f6a-b2d1-da324ea4f736-host-slash\") pod \"iptables-alerter-snwbg\" (UID: \"bdc74bb7-9393-4f6a-b2d1-da324ea4f736\") " pod="openshift-network-operator/iptables-alerter-snwbg" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915242 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-socket-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915262 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915279 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915294 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-wtmp\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915320 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-kubelet\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915324 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-run-openvswitch\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915345 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915354 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915371 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/542f0dbb-ab95-4719-bcf2-6b0441d0feea-socket-dir\") pod \"aws-ebs-csi-driver-node-xsccg\" (UID: \"542f0dbb-ab95-4719-bcf2-6b0441d0feea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xsccg" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915385 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-slash\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915389 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915418 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-socket-dir-parent\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915431 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-kubelet\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915447 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-slash\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915417 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-node-exporter-wtmp\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915447 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-root\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915478 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-multus-socket-dir-parent\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915482 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0681cec5-c66c-49fc-9694-1dd49f6696e5-root\") pod \"node-exporter-76zqz\" (UID: \"0681cec5-c66c-49fc-9694-1dd49f6696e5\") " pod="openshift-monitoring/node-exporter-76zqz" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915487 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-bin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915511 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-multus\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915542 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-netns\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915517 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-bin\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915587 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1080d3e1-b834-48f5-b2aa-28e01af0bff5-host-run-netns\") pod \"ovnkube-node-k9jb7\" (UID: \"1080d3e1-b834-48f5-b2aa-28e01af0bff5\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915546 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-host-var-lib-cni-multus\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915611 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-system-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915640 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-etc-kubernetes\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915664 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8950ff39-1eba-4849-a3fe-b351b2022c0e-hosts-file\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915734 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8950ff39-1eba-4849-a3fe-b351b2022c0e-hosts-file\") pod \"node-resolver-7dt2n\" (UID: \"8950ff39-1eba-4849-a3fe-b351b2022c0e\") " pod="openshift-dns/node-resolver-7dt2n" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915794 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-etc-kubernetes\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:11.916390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:11.915815 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7780d59b-2c7e-4662-89c8-4414580ee652-system-cni-dir\") pod \"multus-9nnr8\" (UID: \"7780d59b-2c7e-4662-89c8-4414580ee652\") " pod="openshift-multus/multus-9nnr8" Nov 04 01:35:12.572464 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:12.572434 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:35:12.993405 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:12.993333 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4m5nq" Nov 04 01:35:14.013034 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:14.013002 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:15.129624 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:15.129578 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:15.130025 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:15.129847 5537 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 01:35:15.547422 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:15.547386 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:15.553062 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:15.553039 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b944f9c8b-bcwpk" Nov 04 01:35:17.597105 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:17.597071 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f8696d4d-cjpdx"] Nov 04 01:35:20.492237 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:20.492160 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:35:20.895925 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:20.895885 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:22.193657 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:22.193625 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:25.786480 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:25.786445 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:28.125416 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:28.125382 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c55hv" Nov 04 01:35:39.993070 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:39.993039 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9jb7" Nov 04 01:35:42.617677 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.617634 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-56f8696d4d-cjpdx" podUID="3051e1d4-8634-414d-ab3e-6c970a0a5cac" containerName="console" containerID="cri-o://b9366095cc8336740085101094b5dd6aecc0c959edfa9aba27f7a9886dff7921" gracePeriod=15 Nov 04 01:35:42.703087 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.703058 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nwps2" Nov 04 01:35:42.816165 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.816135 5537 generic.go:356] "Generic (PLEG): container finished" podID="3051e1d4-8634-414d-ab3e-6c970a0a5cac" containerID="b9366095cc8336740085101094b5dd6aecc0c959edfa9aba27f7a9886dff7921" exitCode=0 Nov 04 01:35:42.816307 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.816195 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f8696d4d-cjpdx" event={"ID":"3051e1d4-8634-414d-ab3e-6c970a0a5cac","Type":"ContainerDied","Data":"b9366095cc8336740085101094b5dd6aecc0c959edfa9aba27f7a9886dff7921"} Nov 04 01:35:42.890047 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.889982 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:42.968897 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.968860 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-config\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-config\") pod \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " Nov 04 01:35:42.969065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.968906 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3051e1d4-8634-414d-ab3e-6c970a0a5cac-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3051e1d4-8634-414d-ab3e-6c970a0a5cac-tmp\") pod \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " Nov 04 01:35:42.969065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.968934 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-oauth-serving-cert\") pod \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " Nov 04 01:35:42.969065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.968992 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-serving-cert\") pod \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " Nov 04 01:35:42.969065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.969011 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-oauth-config\") pod \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " Nov 04 01:35:42.969065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.969052 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-service-ca\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-service-ca\") pod \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " Nov 04 01:35:42.969298 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.969096 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3051e1d4-8634-414d-ab3e-6c970a0a5cac-kube-api-access-s7bvd\" (UniqueName: \"kubernetes.io/projected/3051e1d4-8634-414d-ab3e-6c970a0a5cac-kube-api-access-s7bvd\") pod \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\" (UID: \"3051e1d4-8634-414d-ab3e-6c970a0a5cac\") " Nov 04 01:35:42.969298 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.969282 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3051e1d4-8634-414d-ab3e-6c970a0a5cac-tmp" pod "3051e1d4-8634-414d-ab3e-6c970a0a5cac" (UID: "3051e1d4-8634-414d-ab3e-6c970a0a5cac"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:35:42.969403 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.969356 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-config" pod "3051e1d4-8634-414d-ab3e-6c970a0a5cac" (UID: "3051e1d4-8634-414d-ab3e-6c970a0a5cac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:35:42.969462 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.969441 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-oauth-serving-cert" pod "3051e1d4-8634-414d-ab3e-6c970a0a5cac" (UID: "3051e1d4-8634-414d-ab3e-6c970a0a5cac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:35:42.969534 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.969512 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-service-ca" pod "3051e1d4-8634-414d-ab3e-6c970a0a5cac" (UID: "3051e1d4-8634-414d-ab3e-6c970a0a5cac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:35:42.971594 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.971557 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-serving-cert" pod "3051e1d4-8634-414d-ab3e-6c970a0a5cac" (UID: "3051e1d4-8634-414d-ab3e-6c970a0a5cac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:35:42.971594 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.971569 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3051e1d4-8634-414d-ab3e-6c970a0a5cac-kube-api-access-s7bvd" pod "3051e1d4-8634-414d-ab3e-6c970a0a5cac" (UID: "3051e1d4-8634-414d-ab3e-6c970a0a5cac"). InnerVolumeSpecName "kube-api-access-s7bvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:35:42.971739 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:42.971604 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-oauth-config" pod "3051e1d4-8634-414d-ab3e-6c970a0a5cac" (UID: "3051e1d4-8634-414d-ab3e-6c970a0a5cac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:35:43.069756 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.069721 5537 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-config\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:43.069756 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.069751 5537 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3051e1d4-8634-414d-ab3e-6c970a0a5cac-tmp\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:43.069756 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.069762 5537 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-oauth-serving-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:43.070004 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.069770 5537 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-serving-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:43.070004 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.069807 5537 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3051e1d4-8634-414d-ab3e-6c970a0a5cac-console-oauth-config\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:43.070004 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.069817 5537 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3051e1d4-8634-414d-ab3e-6c970a0a5cac-service-ca\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:43.070004 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.069825 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7bvd\" (UniqueName: \"kubernetes.io/projected/3051e1d4-8634-414d-ab3e-6c970a0a5cac-kube-api-access-s7bvd\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:43.820453 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.820425 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f8696d4d-cjpdx" Nov 04 01:35:43.820994 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.820428 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f8696d4d-cjpdx" event={"ID":"3051e1d4-8634-414d-ab3e-6c970a0a5cac","Type":"ContainerDied","Data":"26a5cb0e95819f513da6dae01a1b2b019546b91c299328f616c69863371acbd0"} Nov 04 01:35:43.820994 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.820556 5537 scope.go:122] "RemoveContainer" containerID="b9366095cc8336740085101094b5dd6aecc0c959edfa9aba27f7a9886dff7921" Nov 04 01:35:43.982952 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:43.982912 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f8696d4d-cjpdx"] Nov 04 01:35:44.032769 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:44.032743 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56f8696d4d-cjpdx"] Nov 04 01:35:44.641141 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:44.641111 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3051e1d4-8634-414d-ab3e-6c970a0a5cac" path="/var/lib/kubelet/pods/3051e1d4-8634-414d-ab3e-6c970a0a5cac/volumes" Nov 04 01:35:45.438906 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.438876 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 01:35:45.439470 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.439211 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="alertmanager" containerID="cri-o://ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e" gracePeriod=120 Nov 04 01:35:45.439470 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.439266 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy-metric" containerID="cri-o://40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8" gracePeriod=120 Nov 04 01:35:45.439470 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.439350 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="prom-label-proxy" containerID="cri-o://1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52" gracePeriod=120 Nov 04 01:35:45.439470 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.439401 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="config-reloader" containerID="cri-o://7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0" gracePeriod=120 Nov 04 01:35:45.439470 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.439402 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy" containerID="cri-o://eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b" gracePeriod=120 Nov 04 01:35:45.440248 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.439335 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy-web" containerID="cri-o://1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413" gracePeriod=120 Nov 04 01:35:45.791471 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.791442 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:45.795115 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.795097 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-844bd489c5-9phdj" Nov 04 01:35:45.830452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.830423 5537 generic.go:356] "Generic (PLEG): container finished" podID="721fb020-df00-4a68-aca9-2b5083d413b1" containerID="1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52" exitCode=0 Nov 04 01:35:45.830452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.830445 5537 generic.go:356] "Generic (PLEG): container finished" podID="721fb020-df00-4a68-aca9-2b5083d413b1" containerID="eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b" exitCode=0 Nov 04 01:35:45.830452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.830451 5537 generic.go:356] "Generic (PLEG): container finished" podID="721fb020-df00-4a68-aca9-2b5083d413b1" containerID="7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0" exitCode=0 Nov 04 01:35:45.830452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.830457 5537 generic.go:356] "Generic (PLEG): container finished" podID="721fb020-df00-4a68-aca9-2b5083d413b1" containerID="ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e" exitCode=0 Nov 04 01:35:45.830773 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.830496 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerDied","Data":"1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52"} Nov 04 01:35:45.830773 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.830573 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerDied","Data":"eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b"} Nov 04 01:35:45.830773 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.830614 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerDied","Data":"7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0"} Nov 04 01:35:45.830773 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:45.830663 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerDied","Data":"ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e"} Nov 04 01:35:46.684549 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.684525 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:46.797195 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797163 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-main-tls\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797359 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797209 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-config-volume\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-config-volume\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797359 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797235 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-metrics-client-ca\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797359 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797274 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-web-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-web-config\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797359 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797294 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-main-db\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797359 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797317 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-config-out\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-config-out\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797359 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797347 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-trusted-ca-bundle\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797655 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797385 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797655 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797537 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797768 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797662 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-tls-assets\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-tls-assets\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797768 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797697 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-cluster-tls-config\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797768 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797713 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-main-db" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:35:46.797768 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797723 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-kube-api-access-xlg2l\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-kube-api-access-xlg2l\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.797988 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797798 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-metrics-client-ca" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:35:46.797988 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.797826 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy\") pod \"721fb020-df00-4a68-aca9-2b5083d413b1\" (UID: \"721fb020-df00-4a68-aca9-2b5083d413b1\") " Nov 04 01:35:46.798101 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.798003 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-trusted-ca-bundle" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:35:46.798152 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.798122 5537 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-metrics-client-ca\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.798152 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.798143 5537 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-main-db\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.798269 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.798159 5537 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/721fb020-df00-4a68-aca9-2b5083d413b1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.801321 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.801291 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-main-tls" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:35:46.801542 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.801512 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-config-volume" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:35:46.801664 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.801626 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-kube-api-access-xlg2l" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "kube-api-access-xlg2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:35:46.801884 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.801757 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-web" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:35:46.801884 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.801848 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-config-out" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:35:46.802034 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.801929 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:35:46.802034 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.802024 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-metric" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:35:46.802638 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.802622 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-tls-assets" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:35:46.805251 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.805230 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-cluster-tls-config" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:35:46.811162 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.811138 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-web-config" pod "721fb020-df00-4a68-aca9-2b5083d413b1" (UID: "721fb020-df00-4a68-aca9-2b5083d413b1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:35:46.837249 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.837218 5537 generic.go:356] "Generic (PLEG): container finished" podID="721fb020-df00-4a68-aca9-2b5083d413b1" containerID="40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8" exitCode=0 Nov 04 01:35:46.837249 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.837243 5537 generic.go:356] "Generic (PLEG): container finished" podID="721fb020-df00-4a68-aca9-2b5083d413b1" containerID="1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413" exitCode=0 Nov 04 01:35:46.837457 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.837294 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:46.837457 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.837298 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerDied","Data":"40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8"} Nov 04 01:35:46.837457 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.837368 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerDied","Data":"1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413"} Nov 04 01:35:46.837457 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.837396 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"721fb020-df00-4a68-aca9-2b5083d413b1","Type":"ContainerDied","Data":"2b84eb6490db90410a1379b40813cfc7ceea5054f14fa03db2fc4100467ea2d1"} Nov 04 01:35:46.837457 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.837436 5537 scope.go:122] "RemoveContainer" containerID="1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52" Nov 04 01:35:46.845350 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.845331 5537 scope.go:122] "RemoveContainer" containerID="40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8" Nov 04 01:35:46.852312 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.852297 5537 scope.go:122] "RemoveContainer" containerID="eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b" Nov 04 01:35:46.858774 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.858758 5537 scope.go:122] "RemoveContainer" containerID="1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413" Nov 04 01:35:46.865617 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.865600 5537 scope.go:122] "RemoveContainer" containerID="7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0" Nov 04 01:35:46.873902 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.873871 5537 scope.go:122] "RemoveContainer" containerID="ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e" Nov 04 01:35:46.880849 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.880826 5537 scope.go:122] "RemoveContainer" containerID="2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d" Nov 04 01:35:46.887064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.887037 5537 scope.go:122] "RemoveContainer" containerID="1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52" Nov 04 01:35:46.887350 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:46.887328 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52\": container with ID starting with 1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52 not found: ID does not exist" containerID="1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52" Nov 04 01:35:46.887434 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.887357 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52"} err="failed to get container status \"1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52\": rpc error: code = NotFound desc = could not find container \"1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52\": container with ID starting with 1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52 not found: ID does not exist" Nov 04 01:35:46.887434 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.887392 5537 scope.go:122] "RemoveContainer" containerID="40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8" Nov 04 01:35:46.887659 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:46.887640 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8\": container with ID starting with 40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8 not found: ID does not exist" containerID="40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8" Nov 04 01:35:46.887713 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.887670 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8"} err="failed to get container status \"40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8\": rpc error: code = NotFound desc = could not find container \"40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8\": container with ID starting with 40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8 not found: ID does not exist" Nov 04 01:35:46.887713 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.887688 5537 scope.go:122] "RemoveContainer" containerID="eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b" Nov 04 01:35:46.888043 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:46.888024 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b\": container with ID starting with eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b not found: ID does not exist" containerID="eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b" Nov 04 01:35:46.888106 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.888047 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b"} err="failed to get container status \"eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b\": rpc error: code = NotFound desc = could not find container \"eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b\": container with ID starting with eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b not found: ID does not exist" Nov 04 01:35:46.888106 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.888061 5537 scope.go:122] "RemoveContainer" containerID="1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413" Nov 04 01:35:46.888307 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:46.888293 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413\": container with ID starting with 1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413 not found: ID does not exist" containerID="1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413" Nov 04 01:35:46.888347 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.888310 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413"} err="failed to get container status \"1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413\": rpc error: code = NotFound desc = could not find container \"1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413\": container with ID starting with 1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413 not found: ID does not exist" Nov 04 01:35:46.888347 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.888324 5537 scope.go:122] "RemoveContainer" containerID="7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0" Nov 04 01:35:46.888552 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:46.888539 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0\": container with ID starting with 7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0 not found: ID does not exist" containerID="7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0" Nov 04 01:35:46.888588 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.888554 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0"} err="failed to get container status \"7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0\": rpc error: code = NotFound desc = could not find container \"7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0\": container with ID starting with 7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0 not found: ID does not exist" Nov 04 01:35:46.888588 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.888565 5537 scope.go:122] "RemoveContainer" containerID="ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e" Nov 04 01:35:46.888802 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:46.888765 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e\": container with ID starting with ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e not found: ID does not exist" containerID="ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e" Nov 04 01:35:46.888876 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.888810 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e"} err="failed to get container status \"ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e\": rpc error: code = NotFound desc = could not find container \"ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e\": container with ID starting with ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e not found: ID does not exist" Nov 04 01:35:46.888876 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.888831 5537 scope.go:122] "RemoveContainer" containerID="2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d" Nov 04 01:35:46.889073 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:46.889058 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d\": container with ID starting with 2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d not found: ID does not exist" containerID="2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d" Nov 04 01:35:46.889116 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.889076 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d"} err="failed to get container status \"2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d\": rpc error: code = NotFound desc = could not find container \"2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d\": container with ID starting with 2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d not found: ID does not exist" Nov 04 01:35:46.889116 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.889087 5537 scope.go:122] "RemoveContainer" containerID="1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52" Nov 04 01:35:46.889297 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.889265 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52"} err="failed to get container status \"1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52\": rpc error: code = NotFound desc = could not find container \"1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52\": container with ID starting with 1d8f36709f4c02b3fd82a008474ae5b6b4302fbed23da55944398a9c59137d52 not found: ID does not exist" Nov 04 01:35:46.889365 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.889298 5537 scope.go:122] "RemoveContainer" containerID="40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8" Nov 04 01:35:46.889535 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.889520 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8"} err="failed to get container status \"40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8\": rpc error: code = NotFound desc = could not find container \"40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8\": container with ID starting with 40b1b7a34cd533ea2f400d1889fccc973ec2470d8edaaed90c4f8a19923f96b8 not found: ID does not exist" Nov 04 01:35:46.889580 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.889535 5537 scope.go:122] "RemoveContainer" containerID="eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b" Nov 04 01:35:46.889733 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.889715 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b"} err="failed to get container status \"eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b\": rpc error: code = NotFound desc = could not find container \"eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b\": container with ID starting with eee83cd28a098d8e4bedae4babcefbfeb34de89738e2d523bd2820034c34f81b not found: ID does not exist" Nov 04 01:35:46.889817 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.889734 5537 scope.go:122] "RemoveContainer" containerID="1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413" Nov 04 01:35:46.889940 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.889925 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413"} err="failed to get container status \"1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413\": rpc error: code = NotFound desc = could not find container \"1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413\": container with ID starting with 1c7e5a33ddf10f2a242e0e81dd9e56c0661126039df18bc88cfdadfb3b3e8413 not found: ID does not exist" Nov 04 01:35:46.889977 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.889941 5537 scope.go:122] "RemoveContainer" containerID="7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0" Nov 04 01:35:46.890132 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.890114 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0"} err="failed to get container status \"7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0\": rpc error: code = NotFound desc = could not find container \"7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0\": container with ID starting with 7c14229b35d66e53b96496bfb2912c4d4c4ede2efb2894df975cbe71796caef0 not found: ID does not exist" Nov 04 01:35:46.890168 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.890136 5537 scope.go:122] "RemoveContainer" containerID="ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e" Nov 04 01:35:46.890350 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.890334 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e"} err="failed to get container status \"ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e\": rpc error: code = NotFound desc = could not find container \"ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e\": container with ID starting with ca0d9dd3370bbd39a116faff575e4cbfd74ea86a2e7c4dc6a8668192bd6b0d8e not found: ID does not exist" Nov 04 01:35:46.890389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.890350 5537 scope.go:122] "RemoveContainer" containerID="2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d" Nov 04 01:35:46.890561 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.890540 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d"} err="failed to get container status \"2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d\": rpc error: code = NotFound desc = could not find container \"2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d\": container with ID starting with 2f3d4adf8543ba783190188ad1b81595ec9ced3183df43dde715d18595075b5d not found: ID does not exist" Nov 04 01:35:46.898936 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.898917 5537 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-config-volume\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.898936 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.898935 5537 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-web-config\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.899015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.898945 5537 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/721fb020-df00-4a68-aca9-2b5083d413b1-config-out\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.899015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.898955 5537 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.899015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.898964 5537 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.899015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.898974 5537 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-tls-assets\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.899015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.898983 5537 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-cluster-tls-config\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.899015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.898993 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlg2l\" (UniqueName: \"kubernetes.io/projected/721fb020-df00-4a68-aca9-2b5083d413b1-kube-api-access-xlg2l\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.899015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.899002 5537 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.899015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.899010 5537 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/721fb020-df00-4a68-aca9-2b5083d413b1-secret-alertmanager-main-tls\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:35:46.975831 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.975775 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 01:35:46.980091 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:46.980068 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 01:35:47.015120 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015097 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 01:35:47.015334 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015323 5537 cpu_manager.go:414] "containerMap: removing container" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="init-config-reloader" Nov 04 01:35:47.015373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015335 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="init-config-reloader" Nov 04 01:35:47.015373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015347 5537 cpu_manager.go:414] "containerMap: removing container" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="config-reloader" Nov 04 01:35:47.015373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015352 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="config-reloader" Nov 04 01:35:47.015373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015363 5537 cpu_manager.go:414] "containerMap: removing container" podUID="3051e1d4-8634-414d-ab3e-6c970a0a5cac" containerName="console" Nov 04 01:35:47.015373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015368 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3051e1d4-8634-414d-ab3e-6c970a0a5cac" containerName="console" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015376 5537 cpu_manager.go:414] "containerMap: removing container" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="prom-label-proxy" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015380 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="prom-label-proxy" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015390 5537 cpu_manager.go:414] "containerMap: removing container" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy-metric" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015395 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy-metric" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015401 5537 cpu_manager.go:414] "containerMap: removing container" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="alertmanager" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015405 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="alertmanager" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015415 5537 cpu_manager.go:414] "containerMap: removing container" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy-web" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015420 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy-web" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015428 5537 cpu_manager.go:414] "containerMap: removing container" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015433 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015469 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="prom-label-proxy" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015476 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy-metric" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015481 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="alertmanager" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015486 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy-web" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015492 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="kube-rbac-proxy" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015497 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="init-config-reloader" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015502 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" containerName="config-reloader" Nov 04 01:35:47.015511 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.015508 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="3051e1d4-8634-414d-ab3e-6c970a0a5cac" containerName="console" Nov 04 01:35:47.018383 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.018367 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.071549 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.071415 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 04 01:35:47.071549 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.071463 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 04 01:35:47.071731 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.071636 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 04 01:35:47.071731 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.071651 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 04 01:35:47.071731 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.071694 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 04 01:35:47.071731 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.071698 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 04 01:35:47.071991 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.071934 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 04 01:35:47.071991 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.071956 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n7sx9\"" Nov 04 01:35:47.072307 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.072275 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 04 01:35:47.072492 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.072478 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 04 01:35:47.100828 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.100800 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.100942 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.100835 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb1beaaa-e157-4914-be92-321101d0af4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.100942 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.100852 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhpvh\" (UniqueName: \"kubernetes.io/projected/eb1beaaa-e157-4914-be92-321101d0af4f-kube-api-access-fhpvh\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.101119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.100929 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.101119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.100981 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb1beaaa-e157-4914-be92-321101d0af4f-config-out\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.101119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.101014 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb1beaaa-e157-4914-be92-321101d0af4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.101119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.101109 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb1beaaa-e157-4914-be92-321101d0af4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.101276 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.101152 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-web-config\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.101276 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.101228 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.101341 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.101277 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1beaaa-e157-4914-be92-321101d0af4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.101341 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.101307 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.101341 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.101327 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.101474 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.101353 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.121496 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.121465 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 01:35:47.202421 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.202385 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb1beaaa-e157-4914-be92-321101d0af4f-config-out\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.202421 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.202421 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb1beaaa-e157-4914-be92-321101d0af4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.202679 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.202442 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb1beaaa-e157-4914-be92-321101d0af4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.202679 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.202466 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-web-config\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.202679 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.202483 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.202679 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.202509 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1beaaa-e157-4914-be92-321101d0af4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.202679 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.202538 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.202679 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.202564 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.203400 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.203354 5537 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 01:35:47.203528 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.203397 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.203625 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.203477 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.203705 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.203656 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb1beaaa-e157-4914-be92-321101d0af4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.203809 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.203767 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhpvh\" (UniqueName: \"kubernetes.io/projected/eb1beaaa-e157-4914-be92-321101d0af4f-kube-api-access-fhpvh\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.203891 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.203733 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb1beaaa-e157-4914-be92-321101d0af4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.203967 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.203920 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.204133 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.204111 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1beaaa-e157-4914-be92-321101d0af4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.205263 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.204620 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb1beaaa-e157-4914-be92-321101d0af4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.207548 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.207510 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb1beaaa-e157-4914-be92-321101d0af4f-config-out\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.207700 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.207644 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.209102 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.207933 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.209997 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.209698 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.210081 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.210005 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-web-config\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.210761 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.210735 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.210882 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.210814 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb1beaaa-e157-4914-be92-321101d0af4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.210882 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.210832 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.211283 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.211266 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb1beaaa-e157-4914-be92-321101d0af4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.266102 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.266074 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhpvh\" (UniqueName: \"kubernetes.io/projected/eb1beaaa-e157-4914-be92-321101d0af4f-kube-api-access-fhpvh\") pod \"alertmanager-main-0\" (UID: \"eb1beaaa-e157-4914-be92-321101d0af4f\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.334190 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.334103 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 01:35:47.761127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.761099 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 01:35:47.764468 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:47.764442 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1beaaa_e157_4914_be92_321101d0af4f.slice/crio-6b902a37cdbc2b1d704e270a282f478110fb1f0bdd9638489247bd462e2b98fb WatchSource:0}: Error finding container 6b902a37cdbc2b1d704e270a282f478110fb1f0bdd9638489247bd462e2b98fb: Status 404 returned error can't find the container with id 6b902a37cdbc2b1d704e270a282f478110fb1f0bdd9638489247bd462e2b98fb Nov 04 01:35:47.843355 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.843325 5537 generic.go:356] "Generic (PLEG): container finished" podID="eb1beaaa-e157-4914-be92-321101d0af4f" containerID="55486d3bd3442ca3674e9902be784b7940e7b8beaac48e0b911c3c2d0b1a0db6" exitCode=0 Nov 04 01:35:47.843464 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.843378 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb1beaaa-e157-4914-be92-321101d0af4f","Type":"ContainerDied","Data":"55486d3bd3442ca3674e9902be784b7940e7b8beaac48e0b911c3c2d0b1a0db6"} Nov 04 01:35:47.843464 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:47.843428 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb1beaaa-e157-4914-be92-321101d0af4f","Type":"ContainerStarted","Data":"6b902a37cdbc2b1d704e270a282f478110fb1f0bdd9638489247bd462e2b98fb"} Nov 04 01:35:48.641112 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:48.641081 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="721fb020-df00-4a68-aca9-2b5083d413b1" path="/var/lib/kubelet/pods/721fb020-df00-4a68-aca9-2b5083d413b1/volumes" Nov 04 01:35:48.850681 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:48.850598 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb1beaaa-e157-4914-be92-321101d0af4f","Type":"ContainerStarted","Data":"484e40fc203393b7a95cf8e1062fc9215e5931c35c5f94e47a4b0aabf7f0dfb0"} Nov 04 01:35:48.850681 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:48.850658 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb1beaaa-e157-4914-be92-321101d0af4f","Type":"ContainerStarted","Data":"8fd721e1265b665b3fff50c2ffccd102b06a2c559cbb3011788e4e64e34453f4"} Nov 04 01:35:48.851110 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:48.850683 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb1beaaa-e157-4914-be92-321101d0af4f","Type":"ContainerStarted","Data":"0d4c719c7c902cce4722494a58aa2547edc65b3091d8bf36976359a492366505"} Nov 04 01:35:48.851110 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:48.850708 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb1beaaa-e157-4914-be92-321101d0af4f","Type":"ContainerStarted","Data":"2b935cca38633395e94bcc7013707b032daabc999bdfb8d395db8fd242998c21"} Nov 04 01:35:48.851110 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:48.850735 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb1beaaa-e157-4914-be92-321101d0af4f","Type":"ContainerStarted","Data":"2db47f2af903c75029b709dd873d9e01912d7fe77fb6c687edd62fcfcaa9bb20"} Nov 04 01:35:48.851110 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:48.850762 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb1beaaa-e157-4914-be92-321101d0af4f","Type":"ContainerStarted","Data":"ac33c30d1cfe5e10f69d9feddc12fd2ee4b474e7096e72557920d1f00327f0b9"} Nov 04 01:35:48.981455 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:48.981399 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9699782260000003 podStartE2EDuration="2.981386435s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.408209ms" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:48.980813188 +0000 UTC m=+38.453407480" watchObservedRunningTime="2026-11-04 01:35:48.981386435 +0000 UTC m=+38.453980721" Nov 04 01:35:49.109600 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.109523 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz"] Nov 04 01:35:49.111816 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.111801 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.164288 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.164259 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Nov 04 01:35:49.164475 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.164354 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Nov 04 01:35:49.164475 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.164371 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Nov 04 01:35:49.164475 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.164420 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Nov 04 01:35:49.164683 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.164664 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6spwl\"" Nov 04 01:35:49.164753 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.164696 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Nov 04 01:35:49.168681 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.168651 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Nov 04 01:35:49.217349 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.217312 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz"] Nov 04 01:35:49.221520 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.221494 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.221651 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.221525 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-metrics-client-ca\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.221651 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.221613 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-serving-certs-ca-bundle\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.221651 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.221634 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt6bl\" (UniqueName: \"kubernetes.io/projected/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-kube-api-access-bt6bl\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.221877 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.221659 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-telemeter-client-tls\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.221877 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.221743 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-federate-client-tls\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.221877 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.221800 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-secret-telemeter-client\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.222023 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.221882 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.323188 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.323151 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-serving-certs-ca-bundle\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.323188 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.323189 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt6bl\" (UniqueName: \"kubernetes.io/projected/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-kube-api-access-bt6bl\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.323452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.323208 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-telemeter-client-tls\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.323452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.323228 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-federate-client-tls\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.323452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.323252 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-secret-telemeter-client\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.323452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.323303 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.323452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.323334 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.323452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.323360 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-metrics-client-ca\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.324146 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.324114 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-serving-certs-ca-bundle\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.324269 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.324123 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-metrics-client-ca\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.324448 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.324420 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.326072 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.326040 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-secret-telemeter-client\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.326072 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.326044 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-telemeter-client-tls\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.326227 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.326145 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-federate-client-tls\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.326407 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.326386 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.384138 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.384066 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt6bl\" (UniqueName: \"kubernetes.io/projected/719ea48d-53c7-4bee-8ba3-e49b30c5f2db-kube-api-access-bt6bl\") pod \"telemeter-client-579dd4fcbf-dsrgz\" (UID: \"719ea48d-53c7-4bee-8ba3-e49b30c5f2db\") " pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.423927 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.423896 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" Nov 04 01:35:49.850307 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.850275 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz"] Nov 04 01:35:49.856516 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:49.856476 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719ea48d_53c7_4bee_8ba3_e49b30c5f2db.slice/crio-1fde83cda2079b68b7fa393b83f780ee24bdd4bf8112cf1b9b82f1452c9e8327 WatchSource:0}: Error finding container 1fde83cda2079b68b7fa393b83f780ee24bdd4bf8112cf1b9b82f1452c9e8327: Status 404 returned error can't find the container with id 1fde83cda2079b68b7fa393b83f780ee24bdd4bf8112cf1b9b82f1452c9e8327 Nov 04 01:35:49.858898 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:49.858882 5537 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 01:35:50.492373 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:35:50.492337 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:35:50.860248 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:50.860215 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" event={"ID":"719ea48d-53c7-4bee-8ba3-e49b30c5f2db","Type":"ContainerStarted","Data":"1fde83cda2079b68b7fa393b83f780ee24bdd4bf8112cf1b9b82f1452c9e8327"} Nov 04 01:35:52.870327 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:52.870292 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" event={"ID":"719ea48d-53c7-4bee-8ba3-e49b30c5f2db","Type":"ContainerStarted","Data":"663f05c4ce812d8a0a27d9324d6894ee9c17275a72f1802f6d0a41fa9ecf4278"} Nov 04 01:35:52.870745 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:52.870345 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" event={"ID":"719ea48d-53c7-4bee-8ba3-e49b30c5f2db","Type":"ContainerStarted","Data":"a9414fc20598e8a5558a8e5ad4ad4bd577111c99a9486327839427a2e3d5d927"} Nov 04 01:35:52.870745 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:52.870363 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" event={"ID":"719ea48d-53c7-4bee-8ba3-e49b30c5f2db","Type":"ContainerStarted","Data":"f41a9950f53e58de5b2f7355f064ba9b25b93c540e77d6a44b46b70d00563239"} Nov 04 01:35:53.092058 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.092008 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-579dd4fcbf-dsrgz" podStartSLOduration=1.965195868 podStartE2EDuration="4.091995769s" totalImagesPullingTime="2.126799901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:53.091455142 +0000 UTC m=+42.564049435" watchObservedRunningTime="2026-11-04 01:35:53.091995769 +0000 UTC m=+42.564590055" Nov 04 01:35:53.480748 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.480711 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d5678db44-spthn"] Nov 04 01:35:53.482591 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.482574 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.535020 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.534995 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2jjdl\"" Nov 04 01:35:53.535170 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.535050 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Nov 04 01:35:53.535170 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.535050 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Nov 04 01:35:53.543559 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.543534 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5678db44-spthn"] Nov 04 01:35:53.561220 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.561188 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-serving-cert\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.561220 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.561221 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxnpd\" (UniqueName: \"kubernetes.io/projected/14ec2525-25cb-436b-b7da-4041e6862af7-kube-api-access-bxnpd\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.561410 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.561248 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-oauth-config\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.561410 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.561347 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-console-config\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.561410 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.561394 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-oauth-serving-cert\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.561495 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.561421 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-service-ca\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.561495 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.561473 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14ec2525-25cb-436b-b7da-4041e6862af7-tmp\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.561557 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.561497 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-trusted-ca-bundle\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.594080 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.594055 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Nov 04 01:35:53.594167 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.594147 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 04 01:35:53.594167 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.594159 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Nov 04 01:35:53.594258 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.594167 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 04 01:35:53.594258 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.594223 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Nov 04 01:35:53.661883 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.661851 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-service-ca\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.661898 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14ec2525-25cb-436b-b7da-4041e6862af7-tmp\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.661916 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-trusted-ca-bundle\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.661947 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-serving-cert\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.661962 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxnpd\" (UniqueName: \"kubernetes.io/projected/14ec2525-25cb-436b-b7da-4041e6862af7-kube-api-access-bxnpd\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.661979 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-oauth-config\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.662000 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-console-config\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.662018 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-oauth-serving-cert\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662384 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.662361 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14ec2525-25cb-436b-b7da-4041e6862af7-tmp\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662738 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.662712 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-service-ca\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662872 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.662759 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-console-config\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.662872 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.662840 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-oauth-serving-cert\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.664555 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.664533 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-serving-cert\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.664643 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.664577 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-oauth-config\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.682384 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.682365 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Nov 04 01:35:53.692835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.692812 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-trusted-ca-bundle\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.725623 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.725600 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxnpd\" (UniqueName: \"kubernetes.io/projected/14ec2525-25cb-436b-b7da-4041e6862af7-kube-api-access-bxnpd\") pod \"console-7d5678db44-spthn\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:53.792758 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:53.792723 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:35:54.165048 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:54.164958 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5678db44-spthn"] Nov 04 01:35:54.195910 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:35:54.195884 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ec2525_25cb_436b_b7da_4041e6862af7.slice/crio-4b446580907b92952cfbfeb847e787cf1991863996cefdb97a7bdde019b6ca30 WatchSource:0}: Error finding container 4b446580907b92952cfbfeb847e787cf1991863996cefdb97a7bdde019b6ca30: Status 404 returned error can't find the container with id 4b446580907b92952cfbfeb847e787cf1991863996cefdb97a7bdde019b6ca30 Nov 04 01:35:54.880370 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:54.880333 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5678db44-spthn" event={"ID":"14ec2525-25cb-436b-b7da-4041e6862af7","Type":"ContainerStarted","Data":"f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc"} Nov 04 01:35:54.880753 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:54.880381 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5678db44-spthn" event={"ID":"14ec2525-25cb-436b-b7da-4041e6862af7","Type":"ContainerStarted","Data":"4b446580907b92952cfbfeb847e787cf1991863996cefdb97a7bdde019b6ca30"} Nov 04 01:35:54.998045 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:35:54.997994 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7d5678db44-spthn" podStartSLOduration=1.997980731 podStartE2EDuration="1.997980731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:54.997218745 +0000 UTC m=+44.469813037" watchObservedRunningTime="2026-11-04 01:35:54.997980731 +0000 UTC m=+44.470575020" Nov 04 01:36:03.793581 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:03.793539 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:36:03.794164 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:03.793607 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:36:03.798224 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:03.798204 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:36:03.916558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:03.916528 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:36:04.417162 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.417124 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-757868d8cc-7tckr"] Nov 04 01:36:04.420406 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.420375 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.445047 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.445013 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-tmp\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.445183 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.445052 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wft5w\" (UniqueName: \"kubernetes.io/projected/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-kube-api-access-wft5w\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.445183 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.445078 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-trusted-ca-bundle\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.445183 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.445105 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-service-ca\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.445285 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.445194 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-console-config\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.445285 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.445246 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-oauth-serving-cert\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.445345 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.445307 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-console-oauth-config\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.445345 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.445332 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-console-serving-cert\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.480099 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.480057 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-757868d8cc-7tckr"] Nov 04 01:36:04.545943 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.545914 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-console-config\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.546136 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.545955 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-oauth-serving-cert\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.546136 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.546000 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-console-oauth-config\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.546136 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.546017 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-console-serving-cert\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.546136 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.546043 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-tmp\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.546136 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.546066 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wft5w\" (UniqueName: \"kubernetes.io/projected/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-kube-api-access-wft5w\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.546136 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.546090 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-trusted-ca-bundle\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.546451 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.546345 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-service-ca\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.546612 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.546581 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-tmp\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.546976 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.546860 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-console-config\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.546976 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.546893 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-oauth-serving-cert\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.547167 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.547147 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-service-ca\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.547230 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.547147 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-trusted-ca-bundle\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.548640 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.548618 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-console-serving-cert\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.548727 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.548654 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-console-oauth-config\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.606796 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.606757 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wft5w\" (UniqueName: \"kubernetes.io/projected/bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5-kube-api-access-wft5w\") pod \"console-757868d8cc-7tckr\" (UID: \"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5\") " pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:04.732923 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:04.732835 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:05.102370 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:05.102336 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-757868d8cc-7tckr"] Nov 04 01:36:05.105962 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:36:05.105934 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9a8ebe_a8b2_4c43_ab49_f52d9aeec0f5.slice/crio-e12e76b9d795c3cab04005f0ab8c26800562f20e4db1ae84e943da7f99c83ac7 WatchSource:0}: Error finding container e12e76b9d795c3cab04005f0ab8c26800562f20e4db1ae84e943da7f99c83ac7: Status 404 returned error can't find the container with id e12e76b9d795c3cab04005f0ab8c26800562f20e4db1ae84e943da7f99c83ac7 Nov 04 01:36:05.921650 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:05.921618 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757868d8cc-7tckr" event={"ID":"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5","Type":"ContainerStarted","Data":"d2ccca0b0b140f88b5b540b21f7e245a200a4ab536b59628dfeecab0b971f928"} Nov 04 01:36:05.921650 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:05.921665 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757868d8cc-7tckr" event={"ID":"bf9a8ebe-a8b2-4c43-ab49-f52d9aeec0f5","Type":"ContainerStarted","Data":"e12e76b9d795c3cab04005f0ab8c26800562f20e4db1ae84e943da7f99c83ac7"} Nov 04 01:36:06.038643 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:06.038587 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-757868d8cc-7tckr" podStartSLOduration=2.038572067 podStartE2EDuration="2.038572067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:36:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:36:06.038383403 +0000 UTC m=+55.510977721" watchObservedRunningTime="2026-11-04 01:36:06.038572067 +0000 UTC m=+55.511166353" Nov 04 01:36:14.732997 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:14.732957 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:14.733406 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:14.733023 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:14.737598 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:14.737581 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:14.958764 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:14.958736 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-757868d8cc-7tckr" Nov 04 01:36:15.105827 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:15.105763 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d5678db44-spthn"] Nov 04 01:36:20.492480 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:36:20.492442 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:36:40.125481 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.125423 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7d5678db44-spthn" podUID="14ec2525-25cb-436b-b7da-4041e6862af7" containerName="console" containerID="cri-o://f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc" gracePeriod=15 Nov 04 01:36:40.381364 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.381307 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:36:40.542476 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.542438 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-serving-cert\") pod \"14ec2525-25cb-436b-b7da-4041e6862af7\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " Nov 04 01:36:40.542476 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.542475 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-oauth-config\") pod \"14ec2525-25cb-436b-b7da-4041e6862af7\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " Nov 04 01:36:40.542718 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.542494 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ec2525-25cb-436b-b7da-4041e6862af7-tmp\" (UniqueName: \"kubernetes.io/empty-dir/14ec2525-25cb-436b-b7da-4041e6862af7-tmp\") pod \"14ec2525-25cb-436b-b7da-4041e6862af7\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " Nov 04 01:36:40.542718 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.542523 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-oauth-serving-cert\") pod \"14ec2525-25cb-436b-b7da-4041e6862af7\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " Nov 04 01:36:40.542718 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.542545 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14ec2525-25cb-436b-b7da-4041e6862af7-kube-api-access-bxnpd\" (UniqueName: \"kubernetes.io/projected/14ec2525-25cb-436b-b7da-4041e6862af7-kube-api-access-bxnpd\") pod \"14ec2525-25cb-436b-b7da-4041e6862af7\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " Nov 04 01:36:40.542718 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.542582 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-console-config\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-console-config\") pod \"14ec2525-25cb-436b-b7da-4041e6862af7\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " Nov 04 01:36:40.542718 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.542632 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-trusted-ca-bundle\") pod \"14ec2525-25cb-436b-b7da-4041e6862af7\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " Nov 04 01:36:40.542718 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.542679 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-service-ca\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-service-ca\") pod \"14ec2525-25cb-436b-b7da-4041e6862af7\" (UID: \"14ec2525-25cb-436b-b7da-4041e6862af7\") " Nov 04 01:36:40.543214 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.542822 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ec2525-25cb-436b-b7da-4041e6862af7-tmp" pod "14ec2525-25cb-436b-b7da-4041e6862af7" (UID: "14ec2525-25cb-436b-b7da-4041e6862af7"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:36:40.543214 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.542920 5537 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14ec2525-25cb-436b-b7da-4041e6862af7-tmp\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:36:40.543314 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.543241 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-oauth-serving-cert" pod "14ec2525-25cb-436b-b7da-4041e6862af7" (UID: "14ec2525-25cb-436b-b7da-4041e6862af7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:36:40.543314 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.543271 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-trusted-ca-bundle" pod "14ec2525-25cb-436b-b7da-4041e6862af7" (UID: "14ec2525-25cb-436b-b7da-4041e6862af7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:36:40.543420 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.543267 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-console-config" pod "14ec2525-25cb-436b-b7da-4041e6862af7" (UID: "14ec2525-25cb-436b-b7da-4041e6862af7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:36:40.543636 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.543612 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-service-ca" pod "14ec2525-25cb-436b-b7da-4041e6862af7" (UID: "14ec2525-25cb-436b-b7da-4041e6862af7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:36:40.545045 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.545021 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-serving-cert" pod "14ec2525-25cb-436b-b7da-4041e6862af7" (UID: "14ec2525-25cb-436b-b7da-4041e6862af7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:36:40.545151 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.545041 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-oauth-config" pod "14ec2525-25cb-436b-b7da-4041e6862af7" (UID: "14ec2525-25cb-436b-b7da-4041e6862af7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:36:40.545195 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.545159 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ec2525-25cb-436b-b7da-4041e6862af7-kube-api-access-bxnpd" pod "14ec2525-25cb-436b-b7da-4041e6862af7" (UID: "14ec2525-25cb-436b-b7da-4041e6862af7"). InnerVolumeSpecName "kube-api-access-bxnpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:36:40.644048 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.643978 5537 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-serving-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:36:40.644048 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.644002 5537 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14ec2525-25cb-436b-b7da-4041e6862af7-console-oauth-config\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:36:40.644048 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.644013 5537 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-oauth-serving-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:36:40.644048 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.644021 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxnpd\" (UniqueName: \"kubernetes.io/projected/14ec2525-25cb-436b-b7da-4041e6862af7-kube-api-access-bxnpd\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:36:40.644048 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.644031 5537 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-console-config\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:36:40.644048 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.644039 5537 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-trusted-ca-bundle\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:36:40.644048 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:40.644047 5537 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14ec2525-25cb-436b-b7da-4041e6862af7-service-ca\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:36:41.045678 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:41.045642 5537 generic.go:356] "Generic (PLEG): container finished" podID="14ec2525-25cb-436b-b7da-4041e6862af7" containerID="f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc" exitCode=0 Nov 04 01:36:41.045857 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:41.045707 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5678db44-spthn" event={"ID":"14ec2525-25cb-436b-b7da-4041e6862af7","Type":"ContainerDied","Data":"f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc"} Nov 04 01:36:41.045857 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:41.045748 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5678db44-spthn" event={"ID":"14ec2525-25cb-436b-b7da-4041e6862af7","Type":"ContainerDied","Data":"4b446580907b92952cfbfeb847e787cf1991863996cefdb97a7bdde019b6ca30"} Nov 04 01:36:41.045857 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:41.045767 5537 scope.go:122] "RemoveContainer" containerID="f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc" Nov 04 01:36:41.045857 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:41.045711 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5678db44-spthn" Nov 04 01:36:41.053604 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:41.053585 5537 scope.go:122] "RemoveContainer" containerID="f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc" Nov 04 01:36:41.053962 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:36:41.053940 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc\": container with ID starting with f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc not found: ID does not exist" containerID="f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc" Nov 04 01:36:41.054036 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:41.053971 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc"} err="failed to get container status \"f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc\": rpc error: code = NotFound desc = could not find container \"f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc\": container with ID starting with f09f3e49955271ef628f7c6dd275c5d8935a8ec7eebd4defbbd3f7c68d617efc not found: ID does not exist" Nov 04 01:36:41.208313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:41.208277 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d5678db44-spthn"] Nov 04 01:36:41.257968 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:41.257938 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d5678db44-spthn"] Nov 04 01:36:42.642166 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:36:42.642126 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14ec2525-25cb-436b-b7da-4041e6862af7" path="/var/lib/kubelet/pods/14ec2525-25cb-436b-b7da-4041e6862af7/volumes" Nov 04 01:36:50.492296 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:36:50.492208 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:37:20.492382 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:37:20.492339 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:37:50.492263 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:37:50.492217 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:37:53.548375 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.548336 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq"] Nov 04 01:37:53.548844 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.548667 5537 cpu_manager.go:414] "containerMap: removing container" podUID="14ec2525-25cb-436b-b7da-4041e6862af7" containerName="console" Nov 04 01:37:53.548844 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.548680 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14ec2525-25cb-436b-b7da-4041e6862af7" containerName="console" Nov 04 01:37:53.548844 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.548743 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="14ec2525-25cb-436b-b7da-4041e6862af7" containerName="console" Nov 04 01:37:53.551910 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.551885 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.582630 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.582599 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs"] Nov 04 01:37:53.585845 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.585830 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.603956 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.603933 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 04 01:37:53.613437 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.613406 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.613437 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.613442 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.613637 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.613462 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.613637 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.613526 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq7xs\" (UniqueName: \"kubernetes.io/projected/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-kube-api-access-xq7xs\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.613637 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.613592 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md8d8\" (UniqueName: \"kubernetes.io/projected/7aff805b-fc00-449f-b69f-33f662eb75d7-kube-api-access-md8d8\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.613637 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.613626 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.631620 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.631595 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 04 01:37:53.631769 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.631695 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-vzvl6\"" Nov 04 01:37:53.653561 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.653536 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-mpxt5\"" Nov 04 01:37:53.654478 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.654449 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq"] Nov 04 01:37:53.655127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.655109 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs"] Nov 04 01:37:53.714105 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.714068 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8d8\" (UniqueName: \"kubernetes.io/projected/7aff805b-fc00-449f-b69f-33f662eb75d7-kube-api-access-md8d8\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.714105 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.714108 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.714350 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.714160 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.714350 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.714177 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.714350 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.714204 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.714350 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.714230 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq7xs\" (UniqueName: \"kubernetes.io/projected/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-kube-api-access-xq7xs\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.714657 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.714631 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.714657 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.714646 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.714886 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.714865 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.714961 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.714930 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.765029 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.764993 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp"] Nov 04 01:37:53.768261 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.768240 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.775613 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.775593 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq7xs\" (UniqueName: \"kubernetes.io/projected/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-kube-api-access-xq7xs\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.775934 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.775912 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md8d8\" (UniqueName: \"kubernetes.io/projected/7aff805b-fc00-449f-b69f-33f662eb75d7-kube-api-access-md8d8\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.814818 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.814743 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.814818 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.814796 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04ccf241-bbe5-4565-8754-61efcab50e92-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.814974 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.814821 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fgn9\" (UniqueName: \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-kube-api-access-9fgn9\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.814974 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.814846 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.814974 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.814868 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.814974 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.814925 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.815099 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.815032 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.826553 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.826525 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 01:37:53.826677 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.826583 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 04 01:37:53.826677 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.826592 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 01:37:53.826844 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.826824 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Nov 04 01:37:53.826897 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.826874 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Nov 04 01:37:53.827028 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.827013 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Nov 04 01:37:53.827104 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.827087 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zvbsw\"" Nov 04 01:37:53.832279 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.832258 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp"] Nov 04 01:37:53.867359 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.867330 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:37:53.901244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.901209 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:37:53.915692 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.915654 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fgn9\" (UniqueName: \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-kube-api-access-9fgn9\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.915831 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.915704 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.915831 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.915745 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.915831 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.915773 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.915831 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.915825 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.916038 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.915886 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.916038 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.915963 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04ccf241-bbe5-4565-8754-61efcab50e92-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.920532 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.919334 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04ccf241-bbe5-4565-8754-61efcab50e92-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.929200 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.922453 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.929200 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.922812 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.929200 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.925165 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.929200 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.926109 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.981283 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.981257 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fgn9\" (UniqueName: \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-kube-api-access-9fgn9\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:53.982632 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:53.982607 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-q6hlp\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:54.089878 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:54.089801 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:54.281718 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:54.281685 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq"] Nov 04 01:37:54.285115 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:37:54.285076 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdbbf6c_229c_4dc1_8eaa_140590d90cf9.slice/crio-895a10adcaf8a42dc1b5d78fae2c342baafda6b3314e2f66a30681c0d9bde703 WatchSource:0}: Error finding container 895a10adcaf8a42dc1b5d78fae2c342baafda6b3314e2f66a30681c0d9bde703: Status 404 returned error can't find the container with id 895a10adcaf8a42dc1b5d78fae2c342baafda6b3314e2f66a30681c0d9bde703 Nov 04 01:37:54.291978 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:54.291956 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs"] Nov 04 01:37:54.295085 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:37:54.295062 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aff805b_fc00_449f_b69f_33f662eb75d7.slice/crio-2e404fc39dfb940dddabd36ad310c4f17552da33d097f219b2cc034527931382 WatchSource:0}: Error finding container 2e404fc39dfb940dddabd36ad310c4f17552da33d097f219b2cc034527931382: Status 404 returned error can't find the container with id 2e404fc39dfb940dddabd36ad310c4f17552da33d097f219b2cc034527931382 Nov 04 01:37:54.302075 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:54.302050 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" event={"ID":"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9","Type":"ContainerStarted","Data":"895a10adcaf8a42dc1b5d78fae2c342baafda6b3314e2f66a30681c0d9bde703"} Nov 04 01:37:54.463024 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:54.462950 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp"] Nov 04 01:37:54.466235 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:37:54.466207 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ccf241_bbe5_4565_8754_61efcab50e92.slice/crio-afdd58a7dc08a960e74883e00dbb3fba94c1c85c3ff891ec1d21142de15b6dd0 WatchSource:0}: Error finding container afdd58a7dc08a960e74883e00dbb3fba94c1c85c3ff891ec1d21142de15b6dd0: Status 404 returned error can't find the container with id afdd58a7dc08a960e74883e00dbb3fba94c1c85c3ff891ec1d21142de15b6dd0 Nov 04 01:37:55.306309 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:55.306272 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" event={"ID":"04ccf241-bbe5-4565-8754-61efcab50e92","Type":"ContainerStarted","Data":"afdd58a7dc08a960e74883e00dbb3fba94c1c85c3ff891ec1d21142de15b6dd0"} Nov 04 01:37:55.307422 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:55.307397 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" event={"ID":"7aff805b-fc00-449f-b69f-33f662eb75d7","Type":"ContainerStarted","Data":"2e404fc39dfb940dddabd36ad310c4f17552da33d097f219b2cc034527931382"} Nov 04 01:37:58.579486 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:58.579453 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:37:58.579830 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:58.579535 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:37:59.328620 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:59.328580 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" event={"ID":"04ccf241-bbe5-4565-8754-61efcab50e92","Type":"ContainerStarted","Data":"2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b"} Nov 04 01:37:59.329010 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:59.328955 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:37:59.331117 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:59.331086 5537 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-q6hlp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 01:37:59.331226 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:59.331153 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" podUID="04ccf241-bbe5-4565-8754-61efcab50e92" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 01:37:59.534067 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:37:59.534003 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" podStartSLOduration=2.42373048 podStartE2EDuration="6.53398294s" totalImagesPullingTime="4.11025246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:37:59.498996831 +0000 UTC m=+168.971591150" watchObservedRunningTime="2026-11-04 01:37:59.53398294 +0000 UTC m=+169.006577230" Nov 04 01:38:00.334953 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:00.334924 5537 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-q6hlp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 01:38:00.335389 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:00.334977 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" podUID="04ccf241-bbe5-4565-8754-61efcab50e92" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 01:38:02.345108 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:02.345068 5537 generic.go:356] "Generic (PLEG): container finished" podID="8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" containerID="b94b1cc56d0467b4b4c898d862f95d84b782c71535afd40e8e308519f5d659f6" exitCode=0 Nov 04 01:38:02.345586 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:02.345149 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" event={"ID":"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9","Type":"ContainerDied","Data":"b94b1cc56d0467b4b4c898d862f95d84b782c71535afd40e8e308519f5d659f6"} Nov 04 01:38:03.335522 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:03.335486 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:38:03.350176 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:03.350142 5537 generic.go:356] "Generic (PLEG): container finished" podID="7aff805b-fc00-449f-b69f-33f662eb75d7" containerID="0b0197583a48a4fe618f1c6019cc2fde706b22f7abf3b8a3c34ba7efd8c1d556" exitCode=0 Nov 04 01:38:03.350659 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:03.350233 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" event={"ID":"7aff805b-fc00-449f-b69f-33f662eb75d7","Type":"ContainerDied","Data":"0b0197583a48a4fe618f1c6019cc2fde706b22f7abf3b8a3c34ba7efd8c1d556"} Nov 04 01:38:06.365825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:06.365760 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" event={"ID":"7aff805b-fc00-449f-b69f-33f662eb75d7","Type":"ContainerStarted","Data":"415ff502159302dcf5dc80a5dac05927acc0b8e605dc77a030ddde883b8b9497"} Nov 04 01:38:06.368109 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:06.368080 5537 generic.go:356] "Generic (PLEG): container finished" podID="8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" containerID="a3baf798a83ada91d7e132cfce38acf551fae064b3c6627e7e78fc39042259c1" exitCode=0 Nov 04 01:38:06.368216 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:06.368122 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" event={"ID":"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9","Type":"ContainerDied","Data":"a3baf798a83ada91d7e132cfce38acf551fae064b3c6627e7e78fc39042259c1"} Nov 04 01:38:07.373145 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:07.373107 5537 generic.go:356] "Generic (PLEG): container finished" podID="7aff805b-fc00-449f-b69f-33f662eb75d7" containerID="415ff502159302dcf5dc80a5dac05927acc0b8e605dc77a030ddde883b8b9497" exitCode=0 Nov 04 01:38:07.373535 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:07.373178 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" event={"ID":"7aff805b-fc00-449f-b69f-33f662eb75d7","Type":"ContainerDied","Data":"415ff502159302dcf5dc80a5dac05927acc0b8e605dc77a030ddde883b8b9497"} Nov 04 01:38:14.408301 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:14.408257 5537 generic.go:356] "Generic (PLEG): container finished" podID="8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" containerID="c46545e2a4812482de1d5c9d656210b35220ef03acf545509cb07be1a5a6a63c" exitCode=0 Nov 04 01:38:14.408739 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:14.408383 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" event={"ID":"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9","Type":"ContainerDied","Data":"c46545e2a4812482de1d5c9d656210b35220ef03acf545509cb07be1a5a6a63c"} Nov 04 01:38:15.414226 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.414184 5537 generic.go:356] "Generic (PLEG): container finished" podID="7aff805b-fc00-449f-b69f-33f662eb75d7" containerID="c8bb49cbd05b984cfb728a001c515b5c82bc9a8e20fd1f9682f8021560591c5a" exitCode=0 Nov 04 01:38:15.414687 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.414264 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" event={"ID":"7aff805b-fc00-449f-b69f-33f662eb75d7","Type":"ContainerDied","Data":"c8bb49cbd05b984cfb728a001c515b5c82bc9a8e20fd1f9682f8021560591c5a"} Nov 04 01:38:15.569940 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.569908 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:38:15.721175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.721145 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-bundle\") pod \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " Nov 04 01:38:15.721376 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.721212 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-util\" (UniqueName: \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-util\") pod \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " Nov 04 01:38:15.721376 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.721269 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-kube-api-access-xq7xs\" (UniqueName: \"kubernetes.io/projected/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-kube-api-access-xq7xs\") pod \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\" (UID: \"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9\") " Nov 04 01:38:15.721548 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.721524 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-bundle" pod "8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" (UID: "8bdbbf6c-229c-4dc1-8eaa-140590d90cf9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:38:15.723635 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.723598 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-kube-api-access-xq7xs" pod "8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" (UID: "8bdbbf6c-229c-4dc1-8eaa-140590d90cf9"). InnerVolumeSpecName "kube-api-access-xq7xs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:38:15.725105 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.725085 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-util" pod "8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" (UID: "8bdbbf6c-229c-4dc1-8eaa-140590d90cf9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:38:15.822100 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.822022 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq7xs\" (UniqueName: \"kubernetes.io/projected/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-kube-api-access-xq7xs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:38:15.822100 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.822049 5537 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-bundle\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:38:15.822100 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:15.822058 5537 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bdbbf6c-229c-4dc1-8eaa-140590d90cf9-util\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:38:16.420015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.419981 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" Nov 04 01:38:16.420015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.420012 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p6mgq" event={"ID":"8bdbbf6c-229c-4dc1-8eaa-140590d90cf9","Type":"ContainerDied","Data":"895a10adcaf8a42dc1b5d78fae2c342baafda6b3314e2f66a30681c0d9bde703"} Nov 04 01:38:16.420552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.420053 5537 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="895a10adcaf8a42dc1b5d78fae2c342baafda6b3314e2f66a30681c0d9bde703" Nov 04 01:38:16.571106 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.571077 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:38:16.629909 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.629882 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-util\" (UniqueName: \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-util\") pod \"7aff805b-fc00-449f-b69f-33f662eb75d7\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " Nov 04 01:38:16.629909 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.629913 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7aff805b-fc00-449f-b69f-33f662eb75d7-kube-api-access-md8d8\" (UniqueName: \"kubernetes.io/projected/7aff805b-fc00-449f-b69f-33f662eb75d7-kube-api-access-md8d8\") pod \"7aff805b-fc00-449f-b69f-33f662eb75d7\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " Nov 04 01:38:16.630093 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.629989 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-bundle\" (UniqueName: \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-bundle\") pod \"7aff805b-fc00-449f-b69f-33f662eb75d7\" (UID: \"7aff805b-fc00-449f-b69f-33f662eb75d7\") " Nov 04 01:38:16.630698 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.630666 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-bundle" pod "7aff805b-fc00-449f-b69f-33f662eb75d7" (UID: "7aff805b-fc00-449f-b69f-33f662eb75d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:38:16.632260 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.632228 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aff805b-fc00-449f-b69f-33f662eb75d7-kube-api-access-md8d8" pod "7aff805b-fc00-449f-b69f-33f662eb75d7" (UID: "7aff805b-fc00-449f-b69f-33f662eb75d7"). InnerVolumeSpecName "kube-api-access-md8d8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:38:16.635158 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.635138 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-util" pod "7aff805b-fc00-449f-b69f-33f662eb75d7" (UID: "7aff805b-fc00-449f-b69f-33f662eb75d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:38:16.731051 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.730966 5537 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-bundle\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:38:16.731051 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.731001 5537 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7aff805b-fc00-449f-b69f-33f662eb75d7-util\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:38:16.731051 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:16.731012 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md8d8\" (UniqueName: \"kubernetes.io/projected/7aff805b-fc00-449f-b69f-33f662eb75d7-kube-api-access-md8d8\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:38:17.425565 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:17.425528 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" event={"ID":"7aff805b-fc00-449f-b69f-33f662eb75d7","Type":"ContainerDied","Data":"2e404fc39dfb940dddabd36ad310c4f17552da33d097f219b2cc034527931382"} Nov 04 01:38:17.425565 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:17.425575 5537 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e404fc39dfb940dddabd36ad310c4f17552da33d097f219b2cc034527931382" Nov 04 01:38:17.426031 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:17.425582 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c7hszs" Nov 04 01:38:20.492134 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:38:20.492050 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:38:27.749913 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.749880 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h"] Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750153 5537 cpu_manager.go:414] "containerMap: removing container" podUID="8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" containerName="extract" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750163 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" containerName="extract" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750180 5537 cpu_manager.go:414] "containerMap: removing container" podUID="7aff805b-fc00-449f-b69f-33f662eb75d7" containerName="pull" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750185 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7aff805b-fc00-449f-b69f-33f662eb75d7" containerName="pull" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750194 5537 cpu_manager.go:414] "containerMap: removing container" podUID="7aff805b-fc00-449f-b69f-33f662eb75d7" containerName="extract" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750199 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7aff805b-fc00-449f-b69f-33f662eb75d7" containerName="extract" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750209 5537 cpu_manager.go:414] "containerMap: removing container" podUID="8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" containerName="util" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750213 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" containerName="util" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750225 5537 cpu_manager.go:414] "containerMap: removing container" podUID="7aff805b-fc00-449f-b69f-33f662eb75d7" containerName="util" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750229 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7aff805b-fc00-449f-b69f-33f662eb75d7" containerName="util" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750241 5537 cpu_manager.go:414] "containerMap: removing container" podUID="8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" containerName="pull" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750245 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" containerName="pull" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750300 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="8bdbbf6c-229c-4dc1-8eaa-140590d90cf9" containerName="extract" Nov 04 01:38:27.750360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.750309 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="7aff805b-fc00-449f-b69f-33f662eb75d7" containerName="extract" Nov 04 01:38:27.752044 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.752029 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.826514 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.826477 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5065b9e6-5774-43e6-b376-18ba81b390fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.826514 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.826513 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6n7d\" (UniqueName: \"kubernetes.io/projected/5065b9e6-5774-43e6-b376-18ba81b390fa-kube-api-access-w6n7d\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.826745 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.826545 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5065b9e6-5774-43e6-b376-18ba81b390fa-tmp\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.826745 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.826630 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5065b9e6-5774-43e6-b376-18ba81b390fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.826745 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.826701 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5065b9e6-5774-43e6-b376-18ba81b390fa-metrics-cert\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.826745 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.826729 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5065b9e6-5774-43e6-b376-18ba81b390fa-manifests\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.878844 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.878797 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 04 01:38:27.879044 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.878867 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 04 01:38:27.879044 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.878905 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 04 01:38:27.879044 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.878915 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 04 01:38:27.879044 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.878971 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-xh4nj\"" Nov 04 01:38:27.879215 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.879057 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 04 01:38:27.928180 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.928128 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5065b9e6-5774-43e6-b376-18ba81b390fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.928180 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.928183 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6n7d\" (UniqueName: \"kubernetes.io/projected/5065b9e6-5774-43e6-b376-18ba81b390fa-kube-api-access-w6n7d\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.928390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.928220 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5065b9e6-5774-43e6-b376-18ba81b390fa-tmp\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.928390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.928246 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5065b9e6-5774-43e6-b376-18ba81b390fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.928390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.928315 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5065b9e6-5774-43e6-b376-18ba81b390fa-metrics-cert\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.928390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.928343 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5065b9e6-5774-43e6-b376-18ba81b390fa-manifests\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.928823 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.928772 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5065b9e6-5774-43e6-b376-18ba81b390fa-manifests\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.930699 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.930675 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5065b9e6-5774-43e6-b376-18ba81b390fa-tmp\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.930960 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.930927 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5065b9e6-5774-43e6-b376-18ba81b390fa-metrics-cert\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.931218 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.931199 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5065b9e6-5774-43e6-b376-18ba81b390fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.931340 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.931305 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5065b9e6-5774-43e6-b376-18ba81b390fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:27.992138 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:27.992109 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h"] Nov 04 01:38:28.003602 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:28.003540 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6n7d\" (UniqueName: \"kubernetes.io/projected/5065b9e6-5774-43e6-b376-18ba81b390fa-kube-api-access-w6n7d\") pod \"opendatahub-operator-controller-manager-7565df5f-spt9h\" (UID: \"5065b9e6-5774-43e6-b376-18ba81b390fa\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:28.066302 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:28.066262 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:28.608493 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:28.608457 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h"] Nov 04 01:38:28.630707 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:38:28.630682 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5065b9e6_5774_43e6_b376_18ba81b390fa.slice/crio-02699a387a1caae9294d5cd8ee5e3fcd04a6d90378e641013efcdbd9c2b84352 WatchSource:0}: Error finding container 02699a387a1caae9294d5cd8ee5e3fcd04a6d90378e641013efcdbd9c2b84352: Status 404 returned error can't find the container with id 02699a387a1caae9294d5cd8ee5e3fcd04a6d90378e641013efcdbd9c2b84352 Nov 04 01:38:29.468502 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:29.468468 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" event={"ID":"5065b9e6-5774-43e6-b376-18ba81b390fa","Type":"ContainerStarted","Data":"02699a387a1caae9294d5cd8ee5e3fcd04a6d90378e641013efcdbd9c2b84352"} Nov 04 01:38:32.483211 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:32.483174 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" event={"ID":"5065b9e6-5774-43e6-b376-18ba81b390fa","Type":"ContainerStarted","Data":"c90427d54a64371174555922638b235ccfb4faa14292a5cfe3b4b92adca00bdb"} Nov 04 01:38:33.488500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:33.488465 5537 generic.go:356] "Generic (PLEG): container finished" podID="5065b9e6-5774-43e6-b376-18ba81b390fa" containerID="c90427d54a64371174555922638b235ccfb4faa14292a5cfe3b4b92adca00bdb" exitCode=0 Nov 04 01:38:33.488984 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:33.488555 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" event={"ID":"5065b9e6-5774-43e6-b376-18ba81b390fa","Type":"ContainerDied","Data":"c90427d54a64371174555922638b235ccfb4faa14292a5cfe3b4b92adca00bdb"} Nov 04 01:38:34.494406 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:34.494367 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" event={"ID":"5065b9e6-5774-43e6-b376-18ba81b390fa","Type":"ContainerStarted","Data":"08a74affb33e797b01f687d01aebe989d83576f56a7c7927ba47d15b6de73ea3"} Nov 04 01:38:34.494854 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:34.494493 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:34.729857 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:34.729737 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" podStartSLOduration=3.069551732 podStartE2EDuration="7.729718594s" totalImagesPullingTime="4.172717954s" totalInitContainerRuntime="487.448908ms" isStatefulPod=false podCreationTimestamp="2026-11-04 01:38:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:38:34.679971061 +0000 UTC m=+204.152565349" watchObservedRunningTime="2026-11-04 01:38:34.729718594 +0000 UTC m=+204.202312888" Nov 04 01:38:45.500918 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:38:45.500885 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7565df5f-spt9h" Nov 04 01:38:50.492147 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:38:50.492104 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:39:00.626059 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.626030 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc"] Nov 04 01:39:00.627834 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.627818 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:00.679949 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.679912 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Nov 04 01:39:00.715401 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.715364 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/856ccc57-5db4-42fa-bdc5-842e369cb24f-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-k45wc\" (UID: \"856ccc57-5db4-42fa-bdc5-842e369cb24f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:00.715561 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.715402 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g4c9\" (UniqueName: \"kubernetes.io/projected/856ccc57-5db4-42fa-bdc5-842e369cb24f-kube-api-access-7g4c9\") pod \"kuadrant-console-plugin-66c4fb575d-k45wc\" (UID: \"856ccc57-5db4-42fa-bdc5-842e369cb24f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:00.715561 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.715518 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/856ccc57-5db4-42fa-bdc5-842e369cb24f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-k45wc\" (UID: \"856ccc57-5db4-42fa-bdc5-842e369cb24f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:00.729352 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.729325 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 04 01:39:00.729352 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.729325 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5hchf\"" Nov 04 01:39:00.729516 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.729357 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 04 01:39:00.729516 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.729370 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Nov 04 01:39:00.730285 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.730266 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc"] Nov 04 01:39:00.815991 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.815954 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/856ccc57-5db4-42fa-bdc5-842e369cb24f-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-k45wc\" (UID: \"856ccc57-5db4-42fa-bdc5-842e369cb24f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:00.816165 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.816006 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g4c9\" (UniqueName: \"kubernetes.io/projected/856ccc57-5db4-42fa-bdc5-842e369cb24f-kube-api-access-7g4c9\") pod \"kuadrant-console-plugin-66c4fb575d-k45wc\" (UID: \"856ccc57-5db4-42fa-bdc5-842e369cb24f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:00.816165 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.816057 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/856ccc57-5db4-42fa-bdc5-842e369cb24f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-k45wc\" (UID: \"856ccc57-5db4-42fa-bdc5-842e369cb24f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:00.816708 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.816685 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/856ccc57-5db4-42fa-bdc5-842e369cb24f-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-k45wc\" (UID: \"856ccc57-5db4-42fa-bdc5-842e369cb24f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:00.818895 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.818869 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/856ccc57-5db4-42fa-bdc5-842e369cb24f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-k45wc\" (UID: \"856ccc57-5db4-42fa-bdc5-842e369cb24f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:00.876753 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.876682 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g4c9\" (UniqueName: \"kubernetes.io/projected/856ccc57-5db4-42fa-bdc5-842e369cb24f-kube-api-access-7g4c9\") pod \"kuadrant-console-plugin-66c4fb575d-k45wc\" (UID: \"856ccc57-5db4-42fa-bdc5-842e369cb24f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:00.949517 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:00.949469 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" Nov 04 01:39:01.315618 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:01.315586 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc"] Nov 04 01:39:01.319244 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:39:01.319215 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod856ccc57_5db4_42fa_bdc5_842e369cb24f.slice/crio-2de7f559cc125e727bc8e0c57f9abb5f9d3562480ed7b4c265ddcbdcbe231cdf WatchSource:0}: Error finding container 2de7f559cc125e727bc8e0c57f9abb5f9d3562480ed7b4c265ddcbdcbe231cdf: Status 404 returned error can't find the container with id 2de7f559cc125e727bc8e0c57f9abb5f9d3562480ed7b4c265ddcbdcbe231cdf Nov 04 01:39:01.602765 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:01.602671 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" event={"ID":"856ccc57-5db4-42fa-bdc5-842e369cb24f","Type":"ContainerStarted","Data":"2de7f559cc125e727bc8e0c57f9abb5f9d3562480ed7b4c265ddcbdcbe231cdf"} Nov 04 01:39:07.539552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.539504 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx"] Nov 04 01:39:07.541583 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.541563 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:07.637289 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.637249 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" event={"ID":"856ccc57-5db4-42fa-bdc5-842e369cb24f","Type":"ContainerStarted","Data":"fa29393f9b1af02a07f7a10843f2548e5e2962a95493a253b7d57459ea508c44"} Nov 04 01:39:07.654334 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.654309 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Nov 04 01:39:07.654334 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.654333 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Nov 04 01:39:07.654508 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.654403 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4c68c\"" Nov 04 01:39:07.657041 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.657023 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx"] Nov 04 01:39:07.676723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.676699 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93aef59-ed70-4b8e-a31b-48d7c9636ab1-tmp\") pod \"kube-auth-proxy-84fbf4d7ff-8vkgx\" (UID: \"e93aef59-ed70-4b8e-a31b-48d7c9636ab1\") " pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:07.676869 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.676729 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e93aef59-ed70-4b8e-a31b-48d7c9636ab1-tls-certs\") pod \"kube-auth-proxy-84fbf4d7ff-8vkgx\" (UID: \"e93aef59-ed70-4b8e-a31b-48d7c9636ab1\") " pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:07.676869 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.676756 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrkds\" (UniqueName: \"kubernetes.io/projected/e93aef59-ed70-4b8e-a31b-48d7c9636ab1-kube-api-access-nrkds\") pod \"kube-auth-proxy-84fbf4d7ff-8vkgx\" (UID: \"e93aef59-ed70-4b8e-a31b-48d7c9636ab1\") " pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:07.778297 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.778259 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93aef59-ed70-4b8e-a31b-48d7c9636ab1-tmp\") pod \"kube-auth-proxy-84fbf4d7ff-8vkgx\" (UID: \"e93aef59-ed70-4b8e-a31b-48d7c9636ab1\") " pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:07.778297 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.778305 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e93aef59-ed70-4b8e-a31b-48d7c9636ab1-tls-certs\") pod \"kube-auth-proxy-84fbf4d7ff-8vkgx\" (UID: \"e93aef59-ed70-4b8e-a31b-48d7c9636ab1\") " pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:07.778526 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.778468 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrkds\" (UniqueName: \"kubernetes.io/projected/e93aef59-ed70-4b8e-a31b-48d7c9636ab1-kube-api-access-nrkds\") pod \"kube-auth-proxy-84fbf4d7ff-8vkgx\" (UID: \"e93aef59-ed70-4b8e-a31b-48d7c9636ab1\") " pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:07.780808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.780768 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93aef59-ed70-4b8e-a31b-48d7c9636ab1-tmp\") pod \"kube-auth-proxy-84fbf4d7ff-8vkgx\" (UID: \"e93aef59-ed70-4b8e-a31b-48d7c9636ab1\") " pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:07.780921 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.780902 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e93aef59-ed70-4b8e-a31b-48d7c9636ab1-tls-certs\") pod \"kube-auth-proxy-84fbf4d7ff-8vkgx\" (UID: \"e93aef59-ed70-4b8e-a31b-48d7c9636ab1\") " pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:07.837307 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.837191 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-k45wc" podStartSLOduration=2.094524946 podStartE2EDuration="7.837176994s" totalImagesPullingTime="5.742652048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:39:07.836964409 +0000 UTC m=+237.309558701" watchObservedRunningTime="2026-11-04 01:39:07.837176994 +0000 UTC m=+237.309771286" Nov 04 01:39:07.844042 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.844015 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrkds\" (UniqueName: \"kubernetes.io/projected/e93aef59-ed70-4b8e-a31b-48d7c9636ab1-kube-api-access-nrkds\") pod \"kube-auth-proxy-84fbf4d7ff-8vkgx\" (UID: \"e93aef59-ed70-4b8e-a31b-48d7c9636ab1\") " pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:07.851851 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:07.851821 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" Nov 04 01:39:08.233960 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:08.233872 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx"] Nov 04 01:39:08.238047 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:39:08.238020 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93aef59_ed70_4b8e_a31b_48d7c9636ab1.slice/crio-9f42393fedb7c5b5e352ff211ddbe5163790286fbb9c1895ba6407b1a10ae3b9 WatchSource:0}: Error finding container 9f42393fedb7c5b5e352ff211ddbe5163790286fbb9c1895ba6407b1a10ae3b9: Status 404 returned error can't find the container with id 9f42393fedb7c5b5e352ff211ddbe5163790286fbb9c1895ba6407b1a10ae3b9 Nov 04 01:39:08.642693 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:08.642660 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" event={"ID":"e93aef59-ed70-4b8e-a31b-48d7c9636ab1","Type":"ContainerStarted","Data":"9f42393fedb7c5b5e352ff211ddbe5163790286fbb9c1895ba6407b1a10ae3b9"} Nov 04 01:39:11.205399 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.205362 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Nov 04 01:39:11.235979 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.235956 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q"] Nov 04 01:39:11.240477 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.240461 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.298072 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.298046 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-rbdnk\"" Nov 04 01:39:11.312071 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.312037 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/65897ea3-ba0f-498b-aa59-38ba7628c8d4-manager-config\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.312213 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.312094 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztlvc\" (UniqueName: \"kubernetes.io/projected/65897ea3-ba0f-498b-aa59-38ba7628c8d4-kube-api-access-ztlvc\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.312213 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.312172 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65897ea3-ba0f-498b-aa59-38ba7628c8d4-metrics-certs\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.312286 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.312247 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65897ea3-ba0f-498b-aa59-38ba7628c8d4-cert\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.345287 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.345262 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Nov 04 01:39:11.345568 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.345548 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Nov 04 01:39:11.346608 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.346590 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q"] Nov 04 01:39:11.353446 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.353432 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Nov 04 01:39:11.353774 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.353759 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Nov 04 01:39:11.353830 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.353771 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Nov 04 01:39:11.412738 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.412660 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/65897ea3-ba0f-498b-aa59-38ba7628c8d4-manager-config\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.412738 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.412696 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztlvc\" (UniqueName: \"kubernetes.io/projected/65897ea3-ba0f-498b-aa59-38ba7628c8d4-kube-api-access-ztlvc\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.412945 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.412882 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65897ea3-ba0f-498b-aa59-38ba7628c8d4-metrics-certs\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.412945 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.412924 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65897ea3-ba0f-498b-aa59-38ba7628c8d4-cert\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.413358 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.413337 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/65897ea3-ba0f-498b-aa59-38ba7628c8d4-manager-config\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.415671 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.415641 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65897ea3-ba0f-498b-aa59-38ba7628c8d4-metrics-certs\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.415773 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.415641 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65897ea3-ba0f-498b-aa59-38ba7628c8d4-cert\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.475060 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.475027 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztlvc\" (UniqueName: \"kubernetes.io/projected/65897ea3-ba0f-498b-aa59-38ba7628c8d4-kube-api-access-ztlvc\") pod \"jobset-controller-manager-9db885d67-lfq7q\" (UID: \"65897ea3-ba0f-498b-aa59-38ba7628c8d4\") " pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.570844 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.570801 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:11.657318 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.657283 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" event={"ID":"e93aef59-ed70-4b8e-a31b-48d7c9636ab1","Type":"ContainerStarted","Data":"3e0deeff46738e7be12c987082fa2d00ad7162f656eb73c02172fb30dfabac39"} Nov 04 01:39:11.774328 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.774211 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-84fbf4d7ff-8vkgx" podStartSLOduration=1.861206079 podStartE2EDuration="4.774193677s" totalImagesPullingTime="2.912987598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:39:11.773539164 +0000 UTC m=+241.246133455" watchObservedRunningTime="2026-11-04 01:39:11.774193677 +0000 UTC m=+241.246787969" Nov 04 01:39:11.942682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:11.942649 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q"] Nov 04 01:39:11.945335 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:39:11.945307 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65897ea3_ba0f_498b_aa59_38ba7628c8d4.slice/crio-3b8d0205a10d113f70a24f73311fb191af9ab113143c06e419d37cc18fb42e7a WatchSource:0}: Error finding container 3b8d0205a10d113f70a24f73311fb191af9ab113143c06e419d37cc18fb42e7a: Status 404 returned error can't find the container with id 3b8d0205a10d113f70a24f73311fb191af9ab113143c06e419d37cc18fb42e7a Nov 04 01:39:12.662548 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:12.662513 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" event={"ID":"65897ea3-ba0f-498b-aa59-38ba7628c8d4","Type":"ContainerStarted","Data":"3b8d0205a10d113f70a24f73311fb191af9ab113143c06e419d37cc18fb42e7a"} Nov 04 01:39:16.681770 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:16.681732 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" event={"ID":"65897ea3-ba0f-498b-aa59-38ba7628c8d4","Type":"ContainerStarted","Data":"7420cf0acb38e4e37a734a3b048d8e27a35957f63fd04d2d9597decd973d1896"} Nov 04 01:39:16.682195 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:16.681854 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:16.826765 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:16.826653 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" podStartSLOduration=1.228923333 podStartE2EDuration="5.826634426s" totalImagesPullingTime="4.597711093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:39:16.825715877 +0000 UTC m=+246.298310173" watchObservedRunningTime="2026-11-04 01:39:16.826634426 +0000 UTC m=+246.299228719" Nov 04 01:39:20.492250 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:39:20.492213 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:39:27.691744 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:39:27.691715 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-9db885d67-lfq7q" Nov 04 01:39:50.493297 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:39:50.493214 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:40:20.493739 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:40:20.493696 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:40:35.460645 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.460612 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74"] Nov 04 01:40:35.463978 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.463958 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.536537 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.536499 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.536537 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.536537 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.536776 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.536562 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9nxl\" (UniqueName: \"kubernetes.io/projected/f177de47-e18c-4c23-9555-6c2be8a45d50-kube-api-access-m9nxl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.536776 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.536667 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f177de47-e18c-4c23-9555-6c2be8a45d50-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.536776 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.536685 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f177de47-e18c-4c23-9555-6c2be8a45d50-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.536776 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.536712 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.536776 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.536730 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.567232 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.567202 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74"] Nov 04 01:40:35.637417 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.637375 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.637619 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.637440 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.637619 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.637456 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.637619 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.637482 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9nxl\" (UniqueName: \"kubernetes.io/projected/f177de47-e18c-4c23-9555-6c2be8a45d50-kube-api-access-m9nxl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.637619 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.637504 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f177de47-e18c-4c23-9555-6c2be8a45d50-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.637619 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.637520 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f177de47-e18c-4c23-9555-6c2be8a45d50-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.637920 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.637698 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.638155 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.638129 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.640119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.640101 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.640224 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.640149 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.640344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.640327 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f177de47-e18c-4c23-9555-6c2be8a45d50-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.640397 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.640362 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f177de47-e18c-4c23-9555-6c2be8a45d50-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.701239 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.701202 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f177de47-e18c-4c23-9555-6c2be8a45d50-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.701393 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.701310 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9nxl\" (UniqueName: \"kubernetes.io/projected/f177de47-e18c-4c23-9555-6c2be8a45d50-kube-api-access-m9nxl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-gjl74\" (UID: \"f177de47-e18c-4c23-9555-6c2be8a45d50\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:35.775139 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:35.775100 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:36.199971 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:36.199882 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74"] Nov 04 01:40:36.203146 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:40:36.203117 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf177de47_e18c_4c23_9555_6c2be8a45d50.slice/crio-960f9116759f05c61a9607b8b88d8c31f740cb47bd9c8c8e78ff7691e69423e8 WatchSource:0}: Error finding container 960f9116759f05c61a9607b8b88d8c31f740cb47bd9c8c8e78ff7691e69423e8: Status 404 returned error can't find the container with id 960f9116759f05c61a9607b8b88d8c31f740cb47bd9c8c8e78ff7691e69423e8 Nov 04 01:40:36.205229 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:36.205197 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:40:36.205326 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:36.205272 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:40:37.016926 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:37.016890 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" event={"ID":"f177de47-e18c-4c23-9555-6c2be8a45d50","Type":"ContainerStarted","Data":"459547ef30dbdc076885d474577a2d842c5cf81d81db7bec559a8e45979d13cc"} Nov 04 01:40:37.017355 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:37.016943 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" event={"ID":"f177de47-e18c-4c23-9555-6c2be8a45d50","Type":"ContainerStarted","Data":"960f9116759f05c61a9607b8b88d8c31f740cb47bd9c8c8e78ff7691e69423e8"} Nov 04 01:40:37.017355 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:37.017062 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:37.018813 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:37.018772 5537 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-gjl74 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 01:40:37.018934 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:37.018833 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" podUID="f177de47-e18c-4c23-9555-6c2be8a45d50" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 01:40:37.223858 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:37.223806 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" podStartSLOduration=2.223768288 podStartE2EDuration="2.223768288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:40:37.223063461 +0000 UTC m=+326.695657752" watchObservedRunningTime="2026-11-04 01:40:37.223768288 +0000 UTC m=+326.696362579" Nov 04 01:40:38.022066 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.022036 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjl74" Nov 04 01:40:38.245246 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.245211 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp"] Nov 04 01:40:38.245651 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.245615 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" podUID="04ccf241-bbe5-4565-8754-61efcab50e92" containerName="discovery" containerID="cri-o://2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b" gracePeriod=30 Nov 04 01:40:38.598832 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.598772 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:40:38.662524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.662444 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-dns-cert\") pod \"04ccf241-bbe5-4565-8754-61efcab50e92\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " Nov 04 01:40:38.662524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.662486 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-istio-token\" (UniqueName: \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-istio-token\") pod \"04ccf241-bbe5-4565-8754-61efcab50e92\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " Nov 04 01:40:38.662524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.662517 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-kube-api-access-9fgn9\" (UniqueName: \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-kube-api-access-9fgn9\") pod \"04ccf241-bbe5-4565-8754-61efcab50e92\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " Nov 04 01:40:38.662804 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.662536 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-cacerts\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-cacerts\") pod \"04ccf241-bbe5-4565-8754-61efcab50e92\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " Nov 04 01:40:38.662804 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.662571 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04ccf241-bbe5-4565-8754-61efcab50e92-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04ccf241-bbe5-4565-8754-61efcab50e92-local-certs\") pod \"04ccf241-bbe5-4565-8754-61efcab50e92\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " Nov 04 01:40:38.662804 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.662595 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-ca-configmap\") pod \"04ccf241-bbe5-4565-8754-61efcab50e92\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " Nov 04 01:40:38.662804 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.662624 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-kubeconfig\") pod \"04ccf241-bbe5-4565-8754-61efcab50e92\" (UID: \"04ccf241-bbe5-4565-8754-61efcab50e92\") " Nov 04 01:40:38.663138 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.663105 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-ca-configmap" pod "04ccf241-bbe5-4565-8754-61efcab50e92" (UID: "04ccf241-bbe5-4565-8754-61efcab50e92"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:40:38.665302 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.665274 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-kube-api-access-9fgn9" pod "04ccf241-bbe5-4565-8754-61efcab50e92" (UID: "04ccf241-bbe5-4565-8754-61efcab50e92"). InnerVolumeSpecName "kube-api-access-9fgn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:40:38.665415 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.665349 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ccf241-bbe5-4565-8754-61efcab50e92-local-certs" pod "04ccf241-bbe5-4565-8754-61efcab50e92" (UID: "04ccf241-bbe5-4565-8754-61efcab50e92"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:40:38.665466 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.665428 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-kubeconfig" pod "04ccf241-bbe5-4565-8754-61efcab50e92" (UID: "04ccf241-bbe5-4565-8754-61efcab50e92"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:40:38.665507 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.665482 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-cacerts" pod "04ccf241-bbe5-4565-8754-61efcab50e92" (UID: "04ccf241-bbe5-4565-8754-61efcab50e92"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:40:38.665591 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.665571 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-dns-cert" pod "04ccf241-bbe5-4565-8754-61efcab50e92" (UID: "04ccf241-bbe5-4565-8754-61efcab50e92"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:40:38.665638 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.665611 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-istio-token" pod "04ccf241-bbe5-4565-8754-61efcab50e92" (UID: "04ccf241-bbe5-4565-8754-61efcab50e92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:40:38.763277 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.763241 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fgn9\" (UniqueName: \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-kube-api-access-9fgn9\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:40:38.763277 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.763270 5537 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-cacerts\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:40:38.763277 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.763281 5537 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04ccf241-bbe5-4565-8754-61efcab50e92-local-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:40:38.763500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.763290 5537 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-ca-configmap\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:40:38.763500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.763301 5537 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-kubeconfig\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:40:38.763500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.763309 5537 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04ccf241-bbe5-4565-8754-61efcab50e92-istio-csr-dns-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:40:38.763500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:38.763317 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04ccf241-bbe5-4565-8754-61efcab50e92-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:40:39.026575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:39.026542 5537 generic.go:356] "Generic (PLEG): container finished" podID="04ccf241-bbe5-4565-8754-61efcab50e92" containerID="2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b" exitCode=0 Nov 04 01:40:39.027064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:39.026592 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" Nov 04 01:40:39.027064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:39.026630 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" event={"ID":"04ccf241-bbe5-4565-8754-61efcab50e92","Type":"ContainerDied","Data":"2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b"} Nov 04 01:40:39.027064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:39.026695 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp" event={"ID":"04ccf241-bbe5-4565-8754-61efcab50e92","Type":"ContainerDied","Data":"afdd58a7dc08a960e74883e00dbb3fba94c1c85c3ff891ec1d21142de15b6dd0"} Nov 04 01:40:39.027064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:39.026723 5537 scope.go:122] "RemoveContainer" containerID="2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b" Nov 04 01:40:39.035526 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:39.035510 5537 scope.go:122] "RemoveContainer" containerID="2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b" Nov 04 01:40:39.035802 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:40:39.035769 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b\": container with ID starting with 2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b not found: ID does not exist" containerID="2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b" Nov 04 01:40:39.035868 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:39.035817 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b"} err="failed to get container status \"2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b\": rpc error: code = NotFound desc = could not find container \"2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b\": container with ID starting with 2654cc6ab2ab864f6971b4431e542e293adf6dedcefda4d6320f4eed52752b9b not found: ID does not exist" Nov 04 01:40:39.190339 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:39.190306 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp"] Nov 04 01:40:39.196712 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:39.196686 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q6hlp"] Nov 04 01:40:40.642840 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:40.642805 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04ccf241-bbe5-4565-8754-61efcab50e92" path="/var/lib/kubelet/pods/04ccf241-bbe5-4565-8754-61efcab50e92/volumes" Nov 04 01:40:50.492817 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:40:50.492752 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:40:56.345840 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.345799 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln"] Nov 04 01:40:56.346472 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.346293 5537 cpu_manager.go:414] "containerMap: removing container" podUID="04ccf241-bbe5-4565-8754-61efcab50e92" containerName="discovery" Nov 04 01:40:56.346472 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.346311 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04ccf241-bbe5-4565-8754-61efcab50e92" containerName="discovery" Nov 04 01:40:56.346472 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.346398 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="04ccf241-bbe5-4565-8754-61efcab50e92" containerName="discovery" Nov 04 01:40:56.349393 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.349370 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.401616 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.401591 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 04 01:40:56.418010 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.417981 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jkx7\" (UniqueName: \"kubernetes.io/projected/09b6cc6a-6f61-484a-bd30-6b100b0acf46-kube-api-access-5jkx7\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.418143 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.418016 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09b6cc6a-6f61-484a-bd30-6b100b0acf46-maas-api-tls\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.418143 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.418049 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09b6cc6a-6f61-484a-bd30-6b100b0acf46-metrics-certs\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.418268 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.418149 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09b6cc6a-6f61-484a-bd30-6b100b0acf46-openshift-service-ca\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.451183 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.451152 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 04 01:40:56.451351 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.451251 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Nov 04 01:40:56.451425 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.451397 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Nov 04 01:40:56.451492 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.451476 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fhqrz\"" Nov 04 01:40:56.452399 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.452379 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln"] Nov 04 01:40:56.519461 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.519421 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09b6cc6a-6f61-484a-bd30-6b100b0acf46-openshift-service-ca\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.519658 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.519539 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jkx7\" (UniqueName: \"kubernetes.io/projected/09b6cc6a-6f61-484a-bd30-6b100b0acf46-kube-api-access-5jkx7\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.519658 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.519576 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09b6cc6a-6f61-484a-bd30-6b100b0acf46-maas-api-tls\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.519658 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.519620 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09b6cc6a-6f61-484a-bd30-6b100b0acf46-metrics-certs\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.521112 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.521083 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09b6cc6a-6f61-484a-bd30-6b100b0acf46-openshift-service-ca\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.525406 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.525377 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09b6cc6a-6f61-484a-bd30-6b100b0acf46-metrics-certs\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.526763 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.526732 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09b6cc6a-6f61-484a-bd30-6b100b0acf46-maas-api-tls\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.581948 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.581919 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jkx7\" (UniqueName: \"kubernetes.io/projected/09b6cc6a-6f61-484a-bd30-6b100b0acf46-kube-api-access-5jkx7\") pod \"maas-api-7dcf8fcc86-d56ln\" (UID: \"09b6cc6a-6f61-484a-bd30-6b100b0acf46\") " pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:56.661975 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:56.661894 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:40:57.031668 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:57.031635 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln"] Nov 04 01:40:57.034859 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:40:57.034832 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b6cc6a_6f61_484a_bd30_6b100b0acf46.slice/crio-f5d7c8a08df04c7545e299d682eb2f42a5de36c6608d50a6a18d382654c383d1 WatchSource:0}: Error finding container f5d7c8a08df04c7545e299d682eb2f42a5de36c6608d50a6a18d382654c383d1: Status 404 returned error can't find the container with id f5d7c8a08df04c7545e299d682eb2f42a5de36c6608d50a6a18d382654c383d1 Nov 04 01:40:57.036219 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:57.036203 5537 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 01:40:57.104207 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:40:57.104173 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" event={"ID":"09b6cc6a-6f61-484a-bd30-6b100b0acf46","Type":"ContainerStarted","Data":"f5d7c8a08df04c7545e299d682eb2f42a5de36c6608d50a6a18d382654c383d1"} Nov 04 01:41:00.120957 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:41:00.120879 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" event={"ID":"09b6cc6a-6f61-484a-bd30-6b100b0acf46","Type":"ContainerStarted","Data":"6d6c3c0cf104949c174b84541c95028e05cbf9a0868c8885d32096e197706510"} Nov 04 01:41:00.121332 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:41:00.121014 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:41:00.238667 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:41:00.238613 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" podStartSLOduration=1.436818745 podStartE2EDuration="4.238597951s" totalImagesPullingTime="2.801779206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:41:00.23748947 +0000 UTC m=+349.710083762" watchObservedRunningTime="2026-11-04 01:41:00.238597951 +0000 UTC m=+349.711192243" Nov 04 01:41:06.130824 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:41:06.130768 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7dcf8fcc86-d56ln" Nov 04 01:41:20.492826 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:41:20.492723 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:41:50.492643 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:41:50.492608 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:42:20.492810 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:42:20.492752 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:42:50.492439 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:42:50.492355 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:43:20.492663 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:43:20.492628 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:43:25.378013 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.377972 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm"] Nov 04 01:43:25.381644 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.381627 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.433956 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.433922 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Nov 04 01:43:25.466357 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.466320 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.466522 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.466366 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.466522 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.466381 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.466604 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.466541 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.466604 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.466571 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.466718 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.466602 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7z7z\" (UniqueName: \"kubernetes.io/projected/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-kube-api-access-l7z7z\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.484252 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.484229 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Nov 04 01:43:25.484252 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.484237 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Nov 04 01:43:25.484376 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.484233 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gw45w\"" Nov 04 01:43:25.485504 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.485484 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm"] Nov 04 01:43:25.567637 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.567600 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.567637 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.567636 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.567909 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.567669 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7z7z\" (UniqueName: \"kubernetes.io/projected/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-kube-api-access-l7z7z\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.567909 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.567738 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.567909 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.567803 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.567909 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.567824 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.568113 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.568087 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.568172 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.568114 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.568228 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.568189 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.570216 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.570194 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.570472 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.570451 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.628334 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.628265 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7z7z\" (UniqueName: \"kubernetes.io/projected/cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6-kube-api-access-l7z7z\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-hvhhm\" (UID: \"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:25.694525 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:25.694488 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:26.068751 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:26.068726 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm"] Nov 04 01:43:26.070470 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:43:26.070442 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf6f332_acf2_4ec4_95f3_5dd1eb4e0ad6.slice/crio-3a9ece0b864f209930d3e1d6db561cb071e03fe325810f629178e85964d31ee8 WatchSource:0}: Error finding container 3a9ece0b864f209930d3e1d6db561cb071e03fe325810f629178e85964d31ee8: Status 404 returned error can't find the container with id 3a9ece0b864f209930d3e1d6db561cb071e03fe325810f629178e85964d31ee8 Nov 04 01:43:26.727396 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:26.727360 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" event={"ID":"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6","Type":"ContainerStarted","Data":"3a9ece0b864f209930d3e1d6db561cb071e03fe325810f629178e85964d31ee8"} Nov 04 01:43:28.737543 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:28.737499 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" event={"ID":"cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6","Type":"ContainerStarted","Data":"7bd846831bd07ace27dedec5dea0d586e0711789ac1bf1699e08f13a51892f7b"} Nov 04 01:43:28.858412 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:28.858353 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" podStartSLOduration=2.262261988 podStartE2EDuration="3.858333376s" totalImagesPullingTime="1.596071388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:43:28.857348942 +0000 UTC m=+498.329943235" watchObservedRunningTime="2026-11-04 01:43:28.858333376 +0000 UTC m=+498.330927669" Nov 04 01:43:29.694646 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:29.694605 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:35.694838 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.694798 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:35.707294 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.707267 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:35.778063 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.778037 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-hvhhm" Nov 04 01:43:35.875205 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.875172 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql"] Nov 04 01:43:35.878665 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.878636 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:35.931531 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.931505 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Nov 04 01:43:35.961908 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.961824 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:35.961908 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.961877 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:35.961908 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.961905 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:35.962133 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.961944 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:35.962133 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.962091 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a01efc0-daf2-481b-b72a-c6540c36f226-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:35.962235 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:35.962149 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjn4j\" (UniqueName: \"kubernetes.io/projected/2a01efc0-daf2-481b-b72a-c6540c36f226-kube-api-access-vjn4j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.029049 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.028617 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql"] Nov 04 01:43:36.063519 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.063483 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a01efc0-daf2-481b-b72a-c6540c36f226-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.063680 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.063536 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjn4j\" (UniqueName: \"kubernetes.io/projected/2a01efc0-daf2-481b-b72a-c6540c36f226-kube-api-access-vjn4j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.063680 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.063592 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.063680 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.063631 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.063680 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.063657 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.063917 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.063679 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.064083 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.064059 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.064165 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.064064 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.064165 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.064115 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.066077 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.066055 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a01efc0-daf2-481b-b72a-c6540c36f226-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.066216 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.066199 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a01efc0-daf2-481b-b72a-c6540c36f226-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.125078 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.125043 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjn4j\" (UniqueName: \"kubernetes.io/projected/2a01efc0-daf2-481b-b72a-c6540c36f226-kube-api-access-vjn4j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql\" (UID: \"2a01efc0-daf2-481b-b72a-c6540c36f226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.194437 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.194402 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:36.571148 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:43:36.571110 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a01efc0_daf2_481b_b72a_c6540c36f226.slice/crio-788447447acb367204e503f795ab20788c14ef81fa352282ef303d103ca54209 WatchSource:0}: Error finding container 788447447acb367204e503f795ab20788c14ef81fa352282ef303d103ca54209: Status 404 returned error can't find the container with id 788447447acb367204e503f795ab20788c14ef81fa352282ef303d103ca54209 Nov 04 01:43:36.676970 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.676941 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql"] Nov 04 01:43:36.773249 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:36.773216 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" event={"ID":"2a01efc0-daf2-481b-b72a-c6540c36f226","Type":"ContainerStarted","Data":"788447447acb367204e503f795ab20788c14ef81fa352282ef303d103ca54209"} Nov 04 01:43:37.779867 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:37.779831 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" event={"ID":"2a01efc0-daf2-481b-b72a-c6540c36f226","Type":"ContainerStarted","Data":"121eebdea1c33ea621487a97d7f837d673a77c4e77d4403eecaa22445ea96f82"} Nov 04 01:43:37.950656 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:37.950602 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" podStartSLOduration=2.366078081 podStartE2EDuration="2.950586958s" totalImagesPullingTime="584.508877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:43:37.900642264 +0000 UTC m=+507.373236557" watchObservedRunningTime="2026-11-04 01:43:37.950586958 +0000 UTC m=+507.423181249" Nov 04 01:43:38.195018 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:38.194934 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:40.509497 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.509466 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-kn75t"] Nov 04 01:43:40.512989 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.512972 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.607495 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.607463 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.607495 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.607499 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-home\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.607701 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.607525 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.607737 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.607690 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.607770 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.607734 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12bab359-8a85-42b0-aaee-04c084b86aed-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.607770 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.607763 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl5ff\" (UniqueName: \"kubernetes.io/projected/12bab359-8a85-42b0-aaee-04c084b86aed-kube-api-access-xl5ff\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.614619 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.614597 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\"" Nov 04 01:43:40.615816 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.615799 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-kn75t"] Nov 04 01:43:40.708914 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.708882 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.709100 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.708925 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12bab359-8a85-42b0-aaee-04c084b86aed-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.709100 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.708959 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl5ff\" (UniqueName: \"kubernetes.io/projected/12bab359-8a85-42b0-aaee-04c084b86aed-kube-api-access-xl5ff\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.709100 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.709016 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.709100 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.709047 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-home\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.709336 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.709169 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.709396 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.709331 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.709396 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.709356 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-home\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.709461 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.709422 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.711468 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.711438 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12bab359-8a85-42b0-aaee-04c084b86aed-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.711695 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.711676 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12bab359-8a85-42b0-aaee-04c084b86aed-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.770080 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.770006 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl5ff\" (UniqueName: \"kubernetes.io/projected/12bab359-8a85-42b0-aaee-04c084b86aed-kube-api-access-xl5ff\") pod \"echo-simulator-kserve-64b6f8f96c-kn75t\" (UID: \"12bab359-8a85-42b0-aaee-04c084b86aed\") " pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:40.825106 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:40.825071 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:41.203616 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:41.203535 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-kn75t"] Nov 04 01:43:41.206711 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:43:41.206685 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12bab359_8a85_42b0_aaee_04c084b86aed.slice/crio-f3ba5ea5e4c9bb4885c1841d7e1595b0f67c76f3b4b80671031933cfbcce137a WatchSource:0}: Error finding container f3ba5ea5e4c9bb4885c1841d7e1595b0f67c76f3b4b80671031933cfbcce137a: Status 404 returned error can't find the container with id f3ba5ea5e4c9bb4885c1841d7e1595b0f67c76f3b4b80671031933cfbcce137a Nov 04 01:43:41.798461 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:41.798430 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" event={"ID":"12bab359-8a85-42b0-aaee-04c084b86aed","Type":"ContainerStarted","Data":"f3ba5ea5e4c9bb4885c1841d7e1595b0f67c76f3b4b80671031933cfbcce137a"} Nov 04 01:43:44.111147 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.111112 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k"] Nov 04 01:43:44.114610 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.114592 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.167101 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.167027 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Nov 04 01:43:44.217538 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.217506 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k"] Nov 04 01:43:44.242115 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.242086 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.242290 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.242123 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.242290 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.242219 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be8c900-640e-44c6-896b-411142151507-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.242290 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.242259 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzmzp\" (UniqueName: \"kubernetes.io/projected/6be8c900-640e-44c6-896b-411142151507-kube-api-access-jzmzp\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.242405 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.242304 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.242405 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.242346 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.343497 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.343461 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.343497 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.343498 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.343772 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.343637 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be8c900-640e-44c6-896b-411142151507-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.343772 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.343667 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzmzp\" (UniqueName: \"kubernetes.io/projected/6be8c900-640e-44c6-896b-411142151507-kube-api-access-jzmzp\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.343772 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.343709 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.343772 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.343769 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.344080 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.344042 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.344159 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.344123 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.344236 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.344215 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.346040 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.346020 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6be8c900-640e-44c6-896b-411142151507-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.346183 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.346166 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be8c900-640e-44c6-896b-411142151507-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.404803 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.404743 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzmzp\" (UniqueName: \"kubernetes.io/projected/6be8c900-640e-44c6-896b-411142151507-kube-api-access-jzmzp\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k\" (UID: \"6be8c900-640e-44c6-896b-411142151507\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.427050 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.426981 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:44.801927 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.801904 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k"] Nov 04 01:43:44.804425 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:43:44.804403 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be8c900_640e_44c6_896b_411142151507.slice/crio-c3b9e7ba5e70881cb4af22daa2946391041429122dd6707dca1c202dad042527 WatchSource:0}: Error finding container c3b9e7ba5e70881cb4af22daa2946391041429122dd6707dca1c202dad042527: Status 404 returned error can't find the container with id c3b9e7ba5e70881cb4af22daa2946391041429122dd6707dca1c202dad042527 Nov 04 01:43:44.815072 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.815042 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" event={"ID":"6be8c900-640e-44c6-896b-411142151507","Type":"ContainerStarted","Data":"c3b9e7ba5e70881cb4af22daa2946391041429122dd6707dca1c202dad042527"} Nov 04 01:43:44.816382 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.816358 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" event={"ID":"12bab359-8a85-42b0-aaee-04c084b86aed","Type":"ContainerStarted","Data":"92471022f78b9324723f2924d07f2a6fd05c78794dd57557422fd61f4dcc4072"} Nov 04 01:43:44.825727 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.825708 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:44.990626 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:44.990571 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" podStartSLOduration=2.320187407 podStartE2EDuration="4.990550255s" totalImagesPullingTime="2.670362848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:43:44.939989687 +0000 UTC m=+514.412583978" watchObservedRunningTime="2026-11-04 01:43:44.990550255 +0000 UTC m=+514.463144547" Nov 04 01:43:45.822456 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:45.822416 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" event={"ID":"6be8c900-640e-44c6-896b-411142151507","Type":"ContainerStarted","Data":"f8410a823071089e82173923610c6595e9d31ee9ae973580a2c440ee4aebf5c1"} Nov 04 01:43:45.940874 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:45.940817 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" podStartSLOduration=1.318465947 podStartE2EDuration="1.94080206s" totalImagesPullingTime="622.336113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:43:45.939841782 +0000 UTC m=+515.412436074" watchObservedRunningTime="2026-11-04 01:43:45.94080206 +0000 UTC m=+515.413396346" Nov 04 01:43:46.195610 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:46.195523 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:46.207715 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:46.207690 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:46.427459 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:46.427412 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:46.837439 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:46.837410 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql" Nov 04 01:43:50.494140 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:43:50.494104 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:43:50.826056 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:50.826015 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:50.838584 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:50.838562 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:50.854326 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:50.854303 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-kn75t" Nov 04 01:43:54.428158 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:54.428123 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:54.440700 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:54.440671 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:43:54.871899 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:43:54.871872 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k" Nov 04 01:44:04.355520 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.355484 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr"] Nov 04 01:44:04.358754 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.358738 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.407595 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.407563 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.407756 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.407611 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecee57db-4ef6-4215-9447-c457d2018691-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.407756 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.407640 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.407756 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.407728 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.407918 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.407757 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecee57db-4ef6-4215-9447-c457d2018691-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.407918 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.407810 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.407918 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.407834 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgqln\" (UniqueName: \"kubernetes.io/projected/ecee57db-4ef6-4215-9447-c457d2018691-kube-api-access-wgqln\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.407918 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.407852 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecee57db-4ef6-4215-9447-c457d2018691-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.407918 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.407892 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.494105 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.494069 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr"] Nov 04 01:44:04.494768 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.494744 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-plld6\"" Nov 04 01:44:04.508872 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.508845 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.508980 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.508883 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.508980 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.508905 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecee57db-4ef6-4215-9447-c457d2018691-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.508980 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.508936 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.509131 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.508980 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgqln\" (UniqueName: \"kubernetes.io/projected/ecee57db-4ef6-4215-9447-c457d2018691-kube-api-access-wgqln\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.509131 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.509008 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecee57db-4ef6-4215-9447-c457d2018691-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.509131 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.509032 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.509131 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.509125 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.509396 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.509182 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecee57db-4ef6-4215-9447-c457d2018691-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.509396 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.509314 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.509486 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.509458 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.509588 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.509564 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.509640 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.509620 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.509873 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.509854 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecee57db-4ef6-4215-9447-c457d2018691-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.511574 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.511551 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecee57db-4ef6-4215-9447-c457d2018691-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.511926 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.511910 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecee57db-4ef6-4215-9447-c457d2018691-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.593720 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.593686 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecee57db-4ef6-4215-9447-c457d2018691-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.593898 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.593825 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgqln\" (UniqueName: \"kubernetes.io/projected/ecee57db-4ef6-4215-9447-c457d2018691-kube-api-access-wgqln\") pod \"maas-default-gateway-openshift-default-778b7b5c47-kh4xr\" (UID: \"ecee57db-4ef6-4215-9447-c457d2018691\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:04.671111 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:04.671036 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:05.093945 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:05.093848 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr"] Nov 04 01:44:05.096736 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:44:05.096711 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecee57db_4ef6_4215_9447_c457d2018691.slice/crio-9e2cac5310dfa6e8f5db50c979554b62c1f67fe2ba4548a1eee3186664259db6 WatchSource:0}: Error finding container 9e2cac5310dfa6e8f5db50c979554b62c1f67fe2ba4548a1eee3186664259db6: Status 404 returned error can't find the container with id 9e2cac5310dfa6e8f5db50c979554b62c1f67fe2ba4548a1eee3186664259db6 Nov 04 01:44:05.910005 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:05.909973 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" event={"ID":"ecee57db-4ef6-4215-9447-c457d2018691","Type":"ContainerStarted","Data":"9e2cac5310dfa6e8f5db50c979554b62c1f67fe2ba4548a1eee3186664259db6"} Nov 04 01:44:09.170351 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:09.170315 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:44:09.170741 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:09.170400 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:44:09.170741 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:09.170444 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:44:09.931353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:09.931321 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" event={"ID":"ecee57db-4ef6-4215-9447-c457d2018691","Type":"ContainerStarted","Data":"695a65e32b8bf0884424611c15183639226204d9b38d7b361b7d03d82d52b236"} Nov 04 01:44:10.151011 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:10.150951 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" podStartSLOduration=2.080288237 podStartE2EDuration="6.150935515s" totalImagesPullingTime="4.070647278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:44:10.101112339 +0000 UTC m=+539.573706631" watchObservedRunningTime="2026-11-04 01:44:10.150935515 +0000 UTC m=+539.623529807" Nov 04 01:44:10.680820 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:10.680107 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:10.684891 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:10.684863 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-kh4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Nov 04 01:44:10.685028 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:10.684916 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" podUID="ecee57db-4ef6-4215-9447-c457d2018691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Nov 04 01:44:11.677825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:11.677151 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-kh4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Nov 04 01:44:11.677825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:11.677212 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" podUID="ecee57db-4ef6-4215-9447-c457d2018691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Nov 04 01:44:12.684249 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:12.684208 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-kh4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Nov 04 01:44:12.684882 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:12.684835 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" podUID="ecee57db-4ef6-4215-9447-c457d2018691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Nov 04 01:44:13.675808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:13.672173 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-kh4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Nov 04 01:44:13.675808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:13.672237 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" podUID="ecee57db-4ef6-4215-9447-c457d2018691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Nov 04 01:44:14.683812 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:14.680190 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-kh4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Nov 04 01:44:14.683812 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:14.680251 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" podUID="ecee57db-4ef6-4215-9447-c457d2018691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Nov 04 01:44:15.671431 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:15.671386 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-kh4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Nov 04 01:44:15.671653 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:15.671444 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" podUID="ecee57db-4ef6-4215-9447-c457d2018691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Nov 04 01:44:16.671481 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:16.671446 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-kh4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Nov 04 01:44:16.672039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:16.671496 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" podUID="ecee57db-4ef6-4215-9447-c457d2018691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Nov 04 01:44:17.692189 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:17.692155 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:17.692690 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:17.692670 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:17.693575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:17.693551 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" Nov 04 01:44:19.482285 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.482248 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2"] Nov 04 01:44:19.489907 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.489883 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.564313 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.564272 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.564477 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.564325 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.564477 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.564419 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.564477 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.564442 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.564477 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.564463 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.564651 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.564480 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.564651 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.564520 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n275c\" (UniqueName: \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-kube-api-access-n275c\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.564713 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.564634 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.564713 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.564694 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.585001 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.584972 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2"] Nov 04 01:44:19.665245 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665210 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665430 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665266 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665430 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665294 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665430 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665316 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665430 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665369 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665430 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665395 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665735 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665422 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665735 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665605 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665735 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665684 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665906 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665749 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665906 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665823 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n275c\" (UniqueName: \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-kube-api-access-n275c\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.665906 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.665824 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.666260 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.666201 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.667128 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.667100 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.667884 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.667867 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.668246 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.668228 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.726077 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.726046 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.726228 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.726086 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n275c\" (UniqueName: \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-kube-api-access-n275c\") pod \"maas-default-gateway-openshift-default-778b7b5c47-hs2x2\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:19.802761 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:19.802718 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:20.231585 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:20.231109 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2"] Nov 04 01:44:20.236824 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:20.236771 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:44:20.236900 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:20.236858 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:44:20.236900 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:20.236887 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:44:20.493275 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:44:20.493193 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:44:20.988623 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:20.988574 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" event={"ID":"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d","Type":"ContainerStarted","Data":"ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f"} Nov 04 01:44:20.988877 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:20.988654 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" event={"ID":"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d","Type":"ContainerStarted","Data":"57516e81447481ec2454c92058f3fe9c1a0d1894c836b66ca5768f7c790ab6df"} Nov 04 01:44:21.208239 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:21.208183 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" podStartSLOduration=2.208170298 podStartE2EDuration="2.208170298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:44:21.157358771 +0000 UTC m=+550.629953064" watchObservedRunningTime="2026-11-04 01:44:21.208170298 +0000 UTC m=+550.680764589" Nov 04 01:44:21.803081 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:21.803051 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:21.804526 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:21.804501 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-hs2x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Nov 04 01:44:21.804646 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:21.804554 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Nov 04 01:44:22.803265 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:22.803234 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-hs2x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Nov 04 01:44:22.803663 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:22.803298 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Nov 04 01:44:23.803923 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:23.803889 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-hs2x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Nov 04 01:44:23.804366 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:23.803939 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Nov 04 01:44:24.803747 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:24.803716 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-hs2x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Nov 04 01:44:24.803952 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:24.803762 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Nov 04 01:44:25.803166 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:25.803134 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-hs2x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Nov 04 01:44:25.803428 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:25.803186 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Nov 04 01:44:26.804021 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:26.803981 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-hs2x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Nov 04 01:44:26.804447 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:26.804039 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Nov 04 01:44:27.803519 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:27.803488 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-hs2x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Nov 04 01:44:27.803707 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:27.803542 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Nov 04 01:44:28.809421 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:28.809388 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:28.809960 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:28.809707 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:28.810470 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:44:28.810446 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:44:50.492935 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:44:50.492901 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:45:07.580575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.580540 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5"] Nov 04 01:45:07.584071 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.584055 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.626019 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.625986 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-data\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.626217 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.626027 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgr9n\" (UniqueName: \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-kube-api-access-hgr9n\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.626217 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.626056 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-socket\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.626217 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.626121 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b93cf7a-3a09-4643-8e00-30513a096dcb-istiod-ca-cert\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.626342 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.626299 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-podinfo\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.626342 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.626335 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-token\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.626413 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.626357 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-credential-socket\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.626450 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.626427 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-envoy\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.626483 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.626472 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-certs\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.659960 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.659930 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5"] Nov 04 01:45:07.728133 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.728095 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-data\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.728383 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.728152 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgr9n\" (UniqueName: \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-kube-api-access-hgr9n\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.728694 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.728653 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-data\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.729845 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.729815 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-socket\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.737953 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.737926 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b93cf7a-3a09-4643-8e00-30513a096dcb-istiod-ca-cert\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.738210 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.738190 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-podinfo\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.738412 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.738322 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-token\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.738569 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.738550 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-credential-socket\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.738707 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.738671 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-envoy\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.738939 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.738881 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-certs\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.739344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.736708 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-socket\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.739448 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.739370 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-certs\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.739747 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.739690 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-credential-socket\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.740268 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.740243 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b93cf7a-3a09-4643-8e00-30513a096dcb-istiod-ca-cert\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.741837 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.741818 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-envoy\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.741971 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.741952 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-podinfo\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.750016 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.749993 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-fa0149-openshift-default-dockercfg-9mtst\"" Nov 04 01:45:07.789812 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.789763 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgr9n\" (UniqueName: \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-kube-api-access-hgr9n\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.799477 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.799453 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-token\") pod \"e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:07.897400 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:07.897314 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:08.334227 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:08.334190 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5"] Nov 04 01:45:08.337383 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:45:08.337354 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b93cf7a_3a09_4643_8e00_30513a096dcb.slice/crio-41e79eaf8e2b6c8dda310d4d3ff86d0bf9a6fc4729538582c92d405337c85e48 WatchSource:0}: Error finding container 41e79eaf8e2b6c8dda310d4d3ff86d0bf9a6fc4729538582c92d405337c85e48: Status 404 returned error can't find the container with id 41e79eaf8e2b6c8dda310d4d3ff86d0bf9a6fc4729538582c92d405337c85e48 Nov 04 01:45:08.339698 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:08.339661 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:08.339810 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:08.339725 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:08.339810 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:08.339753 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:09.212055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:09.212019 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" event={"ID":"7b93cf7a-3a09-4643-8e00-30513a096dcb","Type":"ContainerStarted","Data":"203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293"} Nov 04 01:45:09.212494 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:09.212072 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" event={"ID":"7b93cf7a-3a09-4643-8e00-30513a096dcb","Type":"ContainerStarted","Data":"41e79eaf8e2b6c8dda310d4d3ff86d0bf9a6fc4729538582c92d405337c85e48"} Nov 04 01:45:09.381914 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:09.381865 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" podStartSLOduration=2.381852546 podStartE2EDuration="2.381852546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:45:09.380896698 +0000 UTC m=+598.853490994" watchObservedRunningTime="2026-11-04 01:45:09.381852546 +0000 UTC m=+598.854446838" Nov 04 01:45:09.897438 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:09.897405 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:09.902557 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:09.902521 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:10.048750 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.048712 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh"] Nov 04 01:45:10.052240 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.052217 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.120659 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.120631 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-7af38e-openshift-default-dockercfg-pbl8c\"" Nov 04 01:45:10.147989 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.147908 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh"] Nov 04 01:45:10.167965 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.167934 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-envoy\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.167965 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.167969 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-socket\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.168202 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.167997 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-certs\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.168202 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.168099 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-istio-token\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.168202 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.168126 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6cpc\" (UniqueName: \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-kube-api-access-d6cpc\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.168202 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.168159 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-data\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.168326 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.168299 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8846868-2b08-4ba6-9684-5362173836ae-istio-podinfo\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.168359 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.168333 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-credential-socket\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.168425 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.168407 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8846868-2b08-4ba6-9684-5362173836ae-istiod-ca-cert\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.216571 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.216538 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:10.217621 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.217600 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:10.284221 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.282361 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8846868-2b08-4ba6-9684-5362173836ae-istiod-ca-cert\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.284414 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.284377 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8846868-2b08-4ba6-9684-5362173836ae-istiod-ca-cert\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.284762 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.284589 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-envoy\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.284762 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.284630 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-socket\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.284762 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.284657 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-certs\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.284762 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.284684 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-istio-token\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.284762 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.284712 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6cpc\" (UniqueName: \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-kube-api-access-d6cpc\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.285096 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.284791 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-data\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.285096 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.284863 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8846868-2b08-4ba6-9684-5362173836ae-istio-podinfo\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.285096 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.284879 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-credential-socket\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.285234 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.285162 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-credential-socket\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.285818 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.285761 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-data\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.286062 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.286033 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-certs\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.286321 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.286301 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-socket\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.289082 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.288738 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-envoy\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.289399 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.289356 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8846868-2b08-4ba6-9684-5362173836ae-istio-podinfo\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.347120 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.347087 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-istio-token\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.347281 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.347149 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6cpc\" (UniqueName: \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-kube-api-access-d6cpc\") pod \"e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.365829 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.365765 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:10.796648 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.796625 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh"] Nov 04 01:45:10.799043 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:45:10.799004 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8846868_2b08_4ba6_9684_5362173836ae.slice/crio-11d5da2294d345f8c16f95443c8dad136c609138216cdfd2229e30c75fed3b35 WatchSource:0}: Error finding container 11d5da2294d345f8c16f95443c8dad136c609138216cdfd2229e30c75fed3b35: Status 404 returned error can't find the container with id 11d5da2294d345f8c16f95443c8dad136c609138216cdfd2229e30c75fed3b35 Nov 04 01:45:10.801199 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.801169 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:10.801278 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.801231 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:10.801278 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:10.801259 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:11.224324 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:11.224222 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" event={"ID":"d8846868-2b08-4ba6-9684-5362173836ae","Type":"ContainerStarted","Data":"5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d"} Nov 04 01:45:11.224324 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:11.224278 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" event={"ID":"d8846868-2b08-4ba6-9684-5362173836ae","Type":"ContainerStarted","Data":"11d5da2294d345f8c16f95443c8dad136c609138216cdfd2229e30c75fed3b35"} Nov 04 01:45:11.346479 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:11.346425 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" podStartSLOduration=1.346410466 podStartE2EDuration="1.346410466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:45:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:45:11.344546643 +0000 UTC m=+600.817140934" watchObservedRunningTime="2026-11-04 01:45:11.346410466 +0000 UTC m=+600.819004754" Nov 04 01:45:11.366255 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:11.366222 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:11.371396 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:11.371375 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:12.228826 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:12.228770 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:12.229849 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:12.229820 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:15.101882 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.101851 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm"] Nov 04 01:45:15.105424 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.105404 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.159595 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.159564 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-795045-openshift-default-dockercfg-bm9hd\"" Nov 04 01:45:15.210578 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.210550 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm"] Nov 04 01:45:15.238366 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.238330 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-token\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.238577 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.238392 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-envoy\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.238577 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.238416 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-podinfo\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.238577 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.238525 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-socket\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.238577 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.238562 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n4zq\" (UniqueName: \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-kube-api-access-4n4zq\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.238770 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.238597 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-credential-socket\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.238770 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.238673 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e64bc64-e882-441f-b82b-d5144a7bdea2-istiod-ca-cert\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.238770 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.238702 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-certs\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.238770 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.238723 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-data\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.339486 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.339440 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-token\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.339843 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.339818 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-envoy\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.340018 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.340004 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-podinfo\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.340134 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.340121 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-socket\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.340249 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.340234 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n4zq\" (UniqueName: \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-kube-api-access-4n4zq\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.340368 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.340357 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-credential-socket\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.340501 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.340487 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e64bc64-e882-441f-b82b-d5144a7bdea2-istiod-ca-cert\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.340597 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.340585 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-certs\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.340691 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.340679 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-data\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.340981 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.340952 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-credential-socket\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.341073 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.341053 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-socket\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.341356 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.341337 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-data\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.341657 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.341632 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-certs\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.341742 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.341661 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e64bc64-e882-441f-b82b-d5144a7bdea2-istiod-ca-cert\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.348748 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.348687 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-podinfo\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.360769 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.360699 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-envoy\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.401091 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.401053 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-token\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.404238 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.404210 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n4zq\" (UniqueName: \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-kube-api-access-4n4zq\") pod \"e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.418025 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.418000 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:15.849641 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.849608 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm"] Nov 04 01:45:15.852875 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:45:15.852840 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e64bc64_e882_441f_b82b_d5144a7bdea2.slice/crio-0832f95da42592e3e0cf2e3fd0684eb23f3ce07cdaa76ebc7fd05b3ad512a9b4 WatchSource:0}: Error finding container 0832f95da42592e3e0cf2e3fd0684eb23f3ce07cdaa76ebc7fd05b3ad512a9b4: Status 404 returned error can't find the container with id 0832f95da42592e3e0cf2e3fd0684eb23f3ce07cdaa76ebc7fd05b3ad512a9b4 Nov 04 01:45:15.855210 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.855175 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:15.855303 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.855255 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:15.855360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:15.855303 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:16.250418 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:16.250381 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" event={"ID":"4e64bc64-e882-441f-b82b-d5144a7bdea2","Type":"ContainerStarted","Data":"35043f885e8622601bef85aa1a156aa06776e1cd8d381b2f33c7f4e5e36bb550"} Nov 04 01:45:16.250937 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:16.250443 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" event={"ID":"4e64bc64-e882-441f-b82b-d5144a7bdea2","Type":"ContainerStarted","Data":"0832f95da42592e3e0cf2e3fd0684eb23f3ce07cdaa76ebc7fd05b3ad512a9b4"} Nov 04 01:45:16.371112 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:16.371058 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" podStartSLOduration=1.371045702 podStartE2EDuration="1.371045702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:45:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:45:16.369229505 +0000 UTC m=+605.841823797" watchObservedRunningTime="2026-11-04 01:45:16.371045702 +0000 UTC m=+605.843639996" Nov 04 01:45:16.418359 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:16.418323 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:16.423401 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:16.423374 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:17.254955 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:17.254924 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:17.255944 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:17.255925 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:45:20.493313 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:45:20.493279 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:45:28.927710 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:28.927675 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd"] Nov 04 01:45:28.931475 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:28.931455 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:28.984411 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:28.984381 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-7af38e-serving-cert\"" Nov 04 01:45:29.012413 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.012369 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.012560 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.012423 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5gtt\" (UniqueName: \"kubernetes.io/projected/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-kube-api-access-l5gtt\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.012560 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.012522 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-metrics-certs\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.012664 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.012569 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.035560 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.035529 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd"] Nov 04 01:45:29.113362 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.113329 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.113519 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.113369 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5gtt\" (UniqueName: \"kubernetes.io/projected/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-kube-api-access-l5gtt\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.113519 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:45:29.113494 5537 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-serving-cert: secret "maas-api-e2e-worker-w0-7af38e-serving-cert" not found Nov 04 01:45:29.113591 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:45:29.113582 5537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-maas-api-tls podName:ea5c525f-f973-4497-a1c7-e3c5ad90e06c nodeName:}" failed. No retries permitted until 2026-11-04 01:45:29.613559105 +0000 UTC m=+619.086153401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-maas-api-tls") pod "maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" (UID: "ea5c525f-f973-4497-a1c7-e3c5ad90e06c") : secret "maas-api-e2e-worker-w0-7af38e-serving-cert" not found Nov 04 01:45:29.113636 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.113496 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-metrics-certs\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.113704 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.113686 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.114282 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.114255 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.115978 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.115959 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-metrics-certs\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.181882 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.181709 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5gtt\" (UniqueName: \"kubernetes.io/projected/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-kube-api-access-l5gtt\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.619628 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.619594 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.622129 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.622100 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:29.844468 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:29.844430 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:30.219865 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:30.219759 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd"] Nov 04 01:45:30.222962 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:45:30.222925 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5c525f_f973_4497_a1c7_e3c5ad90e06c.slice/crio-8dcf930f3acb42db6b2d87b09b21fd16460722d31e7ff895a1f1bdbf62edfe4c WatchSource:0}: Error finding container 8dcf930f3acb42db6b2d87b09b21fd16460722d31e7ff895a1f1bdbf62edfe4c: Status 404 returned error can't find the container with id 8dcf930f3acb42db6b2d87b09b21fd16460722d31e7ff895a1f1bdbf62edfe4c Nov 04 01:45:30.319475 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:30.319436 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" event={"ID":"ea5c525f-f973-4497-a1c7-e3c5ad90e06c","Type":"ContainerStarted","Data":"8dcf930f3acb42db6b2d87b09b21fd16460722d31e7ff895a1f1bdbf62edfe4c"} Nov 04 01:45:31.326369 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:31.326261 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" event={"ID":"ea5c525f-f973-4497-a1c7-e3c5ad90e06c","Type":"ContainerStarted","Data":"e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173"} Nov 04 01:45:31.326369 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:31.326349 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:31.443727 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:31.443674 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" podStartSLOduration=2.641254006 podStartE2EDuration="3.443659708s" totalImagesPullingTime="802.405702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:45:31.442257618 +0000 UTC m=+620.914851910" watchObservedRunningTime="2026-11-04 01:45:31.443659708 +0000 UTC m=+620.916253994" Nov 04 01:45:34.092097 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.092059 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb"] Nov 04 01:45:34.095955 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.095932 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.147483 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.147456 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-f4d202-serving-cert\"" Nov 04 01:45:34.174814 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.173838 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.174814 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.173934 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-metrics-certs\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.174814 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.173987 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt4g6\" (UniqueName: \"kubernetes.io/projected/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-kube-api-access-xt4g6\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.174814 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.174019 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-maas-api-tls\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.198614 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.198581 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb"] Nov 04 01:45:34.275603 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.275567 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-metrics-certs\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.275834 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.275628 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt4g6\" (UniqueName: \"kubernetes.io/projected/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-kube-api-access-xt4g6\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.275834 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.275655 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-maas-api-tls\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.275834 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.275809 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.276013 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:45:34.275883 5537 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-serving-cert: secret "maas-api-e2e-worker-w4-f4d202-serving-cert" not found Nov 04 01:45:34.276013 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:45:34.275951 5537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-maas-api-tls podName:aa529724-afc1-4dcc-9dcb-6e40e20d4b62 nodeName:}" failed. No retries permitted until 2026-11-04 01:45:34.775933731 +0000 UTC m=+624.248528018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-maas-api-tls") pod "maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" (UID: "aa529724-afc1-4dcc-9dcb-6e40e20d4b62") : secret "maas-api-e2e-worker-w4-f4d202-serving-cert" not found Nov 04 01:45:34.276518 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.276493 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.278301 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.278272 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-metrics-certs\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.336713 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.336676 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt4g6\" (UniqueName: \"kubernetes.io/projected/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-kube-api-access-xt4g6\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.781159 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.781122 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-maas-api-tls\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:34.783660 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:34.783632 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-maas-api-tls\") pod \"maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:35.009573 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:35.009527 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:35.385814 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:35.385767 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb"] Nov 04 01:45:35.388653 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:45:35.388616 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa529724_afc1_4dcc_9dcb_6e40e20d4b62.slice/crio-2c2c7f30cdc16b2035ed7ab70601ef7793d07f947b30552d76f2c78551738c1e WatchSource:0}: Error finding container 2c2c7f30cdc16b2035ed7ab70601ef7793d07f947b30552d76f2c78551738c1e: Status 404 returned error can't find the container with id 2c2c7f30cdc16b2035ed7ab70601ef7793d07f947b30552d76f2c78551738c1e Nov 04 01:45:36.368890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:36.368859 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" event={"ID":"aa529724-afc1-4dcc-9dcb-6e40e20d4b62","Type":"ContainerStarted","Data":"4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72"} Nov 04 01:45:36.369019 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:36.368921 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" event={"ID":"aa529724-afc1-4dcc-9dcb-6e40e20d4b62","Type":"ContainerStarted","Data":"2c2c7f30cdc16b2035ed7ab70601ef7793d07f947b30552d76f2c78551738c1e"} Nov 04 01:45:36.369019 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:36.368964 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:36.500534 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:36.500471 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" podStartSLOduration=1.5893803260000001 podStartE2EDuration="2.500453519s" totalImagesPullingTime="911.073193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:45:36.500279333 +0000 UTC m=+625.972873625" watchObservedRunningTime="2026-11-04 01:45:36.500453519 +0000 UTC m=+625.973047812" Nov 04 01:45:37.337543 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:37.337518 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:45:42.397871 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:42.397842 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:45:46.456799 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.456671 5537 generic.go:356] "Generic (PLEG): container finished" podID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerID="203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293" exitCode=0 Nov 04 01:45:46.456799 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.456754 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" event={"ID":"7b93cf7a-3a09-4643-8e00-30513a096dcb","Type":"ContainerDied","Data":"203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293"} Nov 04 01:45:46.457379 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.457245 5537 scope.go:122] "RemoveContainer" containerID="203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293" Nov 04 01:45:46.458374 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.458349 5537 generic.go:356] "Generic (PLEG): container finished" podID="d8846868-2b08-4ba6-9684-5362173836ae" containerID="5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d" exitCode=0 Nov 04 01:45:46.458478 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.458385 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" event={"ID":"d8846868-2b08-4ba6-9684-5362173836ae","Type":"ContainerDied","Data":"5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d"} Nov 04 01:45:46.458661 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.458632 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:46.458725 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.458714 5537 scope.go:122] "RemoveContainer" containerID="5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d" Nov 04 01:45:46.458802 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.458719 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:46.458866 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.458769 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:46.459835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.459812 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:46.459906 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.459872 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:46.459945 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:46.459905 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:45:47.498728 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:47.497838 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" event={"ID":"d8846868-2b08-4ba6-9684-5362173836ae","Type":"ContainerStarted","Data":"445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f"} Nov 04 01:45:47.512401 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:47.512358 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" event={"ID":"7b93cf7a-3a09-4643-8e00-30513a096dcb","Type":"ContainerStarted","Data":"38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572"} Nov 04 01:45:47.906975 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:47.906942 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:47.907724 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:47.907265 5537 patch_prober.go:29] interesting pod/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Nov 04 01:45:47.907952 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:47.907927 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Nov 04 01:45:48.367238 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:48.367201 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:48.367677 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:48.367547 5537 patch_prober.go:29] interesting pod/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Nov 04 01:45:48.367892 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:48.367868 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Nov 04 01:45:48.899216 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:48.899175 5537 patch_prober.go:29] interesting pod/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Nov 04 01:45:48.899860 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:48.899824 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Nov 04 01:45:49.367281 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:49.367241 5537 patch_prober.go:29] interesting pod/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Nov 04 01:45:49.367661 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:49.367628 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Nov 04 01:45:49.899188 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:49.899152 5537 patch_prober.go:29] interesting pod/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Nov 04 01:45:49.899486 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:49.899456 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Nov 04 01:45:50.367281 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:50.367241 5537 patch_prober.go:29] interesting pod/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Nov 04 01:45:50.367592 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:50.367558 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Nov 04 01:45:50.530044 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:45:50.530005 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:45:50.899173 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:50.899138 5537 patch_prober.go:29] interesting pod/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Nov 04 01:45:50.899478 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:50.899440 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Nov 04 01:45:51.367404 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:51.367368 5537 patch_prober.go:29] interesting pod/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Nov 04 01:45:51.368076 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:51.368035 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Nov 04 01:45:51.899809 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:51.899325 5537 patch_prober.go:29] interesting pod/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Nov 04 01:45:51.899809 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:51.899405 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Nov 04 01:45:52.369316 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:52.369276 5537 patch_prober.go:29] interesting pod/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Nov 04 01:45:52.369980 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:52.369942 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Nov 04 01:45:52.902050 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:52.902021 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:52.902310 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:52.902287 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:52.903068 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:52.903048 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:45:53.381166 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:53.381133 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:53.383126 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:53.383102 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:45:53.384331 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:45:53.384304 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 01:46:01.609059 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:01.609025 5537 generic.go:356] "Generic (PLEG): container finished" podID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerID="35043f885e8622601bef85aa1a156aa06776e1cd8d381b2f33c7f4e5e36bb550" exitCode=0 Nov 04 01:46:01.609543 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:01.609099 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" event={"ID":"4e64bc64-e882-441f-b82b-d5144a7bdea2","Type":"ContainerDied","Data":"35043f885e8622601bef85aa1a156aa06776e1cd8d381b2f33c7f4e5e36bb550"} Nov 04 01:46:01.609543 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:01.609486 5537 scope.go:122] "RemoveContainer" containerID="35043f885e8622601bef85aa1a156aa06776e1cd8d381b2f33c7f4e5e36bb550" Nov 04 01:46:01.610831 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:01.610810 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:46:01.610897 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:01.610871 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:46:01.610938 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:01.610902 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:46:02.255656 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:02.255621 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:46:02.616295 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:02.616194 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" event={"ID":"4e64bc64-e882-441f-b82b-d5144a7bdea2","Type":"ContainerStarted","Data":"94d5cf118d9065cef68de1fb4aeaa3c4bc7f600ca15ae9d6e13cb58b8dbf8148"} Nov 04 01:46:03.418266 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:03.418226 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:46:03.419486 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:03.419463 5537 patch_prober.go:29] interesting pod/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Nov 04 01:46:03.419593 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:03.419520 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Nov 04 01:46:04.418472 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:04.418441 5537 patch_prober.go:29] interesting pod/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Nov 04 01:46:04.418891 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:04.418496 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Nov 04 01:46:05.418760 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:05.418726 5537 patch_prober.go:29] interesting pod/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Nov 04 01:46:05.419213 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:05.418810 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Nov 04 01:46:06.418372 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:06.418339 5537 patch_prober.go:29] interesting pod/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Nov 04 01:46:06.418554 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:06.418396 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Nov 04 01:46:07.419375 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:07.419338 5537 patch_prober.go:29] interesting pod/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Nov 04 01:46:07.419905 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:07.419413 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Nov 04 01:46:08.422537 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:08.422509 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:46:08.423022 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:08.422799 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:46:08.423577 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:08.423561 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:46:20.493389 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:46:20.493355 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:46:33.093140 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.093102 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr"] Nov 04 01:46:33.096719 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.096703 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.198740 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.198705 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7af38e\"/\"openshift-service-ca.crt\"" Nov 04 01:46:33.198992 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.198806 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7af38e\"/\"kube-root-ca.crt\"" Nov 04 01:46:33.198992 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.198865 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7af38e\"/\"default-dockercfg-7m2lf\"" Nov 04 01:46:33.198992 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.198890 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7af38e\"/\"simulator-w0-7af38e-kserve-self-signed-certs\"" Nov 04 01:46:33.200532 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.200516 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr"] Nov 04 01:46:33.204642 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.204621 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2227ce37-682e-409b-b5fe-867cd8848a0d-tls-certs\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.204696 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.204655 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-model-cache\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.204797 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.204764 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-home\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.204859 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.204820 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-dshm\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.204905 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.204876 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-tmp-dir\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.204905 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.204895 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lmnh\" (UniqueName: \"kubernetes.io/projected/2227ce37-682e-409b-b5fe-867cd8848a0d-kube-api-access-6lmnh\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.306238 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.306202 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2227ce37-682e-409b-b5fe-867cd8848a0d-tls-certs\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.306238 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.306246 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-model-cache\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.306519 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.306299 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-home\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.306519 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.306321 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-dshm\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.306519 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.306345 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-tmp-dir\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.306519 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.306363 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lmnh\" (UniqueName: \"kubernetes.io/projected/2227ce37-682e-409b-b5fe-867cd8848a0d-kube-api-access-6lmnh\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.306847 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.306821 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-model-cache\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.306934 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.306849 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-home\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.306934 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.306887 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-tmp-dir\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.308792 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.308763 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-dshm\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.309076 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.309058 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2227ce37-682e-409b-b5fe-867cd8848a0d-tls-certs\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.369574 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.369495 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lmnh\" (UniqueName: \"kubernetes.io/projected/2227ce37-682e-409b-b5fe-867cd8848a0d-kube-api-access-6lmnh\") pod \"simulator-w0-7af38e-kserve-55bd9c4467-vwmkr\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.408001 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.407973 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:33.780373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:33.780351 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr"] Nov 04 01:46:33.783083 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:46:33.783057 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2227ce37_682e_409b_b5fe_867cd8848a0d.slice/crio-98b166e343b6012ec5d639836b0b70a0b2649c1ccd0f34bfd50a47e15dd097fa WatchSource:0}: Error finding container 98b166e343b6012ec5d639836b0b70a0b2649c1ccd0f34bfd50a47e15dd097fa: Status 404 returned error can't find the container with id 98b166e343b6012ec5d639836b0b70a0b2649c1ccd0f34bfd50a47e15dd097fa Nov 04 01:46:34.767231 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:34.767192 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" event={"ID":"2227ce37-682e-409b-b5fe-867cd8848a0d","Type":"ContainerStarted","Data":"2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a"} Nov 04 01:46:34.767231 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:34.767235 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" event={"ID":"2227ce37-682e-409b-b5fe-867cd8848a0d","Type":"ContainerStarted","Data":"98b166e343b6012ec5d639836b0b70a0b2649c1ccd0f34bfd50a47e15dd097fa"} Nov 04 01:46:34.886914 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:34.886860 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" podStartSLOduration=1.8868469669999999 podStartE2EDuration="1.886846967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:46:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:46:34.884852885 +0000 UTC m=+684.357447177" watchObservedRunningTime="2026-11-04 01:46:34.886846967 +0000 UTC m=+684.359441261" Nov 04 01:46:35.408651 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:35.408614 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:43.408467 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:43.408427 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:43.420833 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:43.420807 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:43.827055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:43.827019 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:46:50.492918 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:46:50.492882 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:46:51.916235 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:51.916199 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff"] Nov 04 01:46:51.919993 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:51.919977 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:51.974360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:51.974319 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-795045\"/\"kube-root-ca.crt\"" Nov 04 01:46:51.995541 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:51.995505 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-dshm\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:51.995541 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:51.995543 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-model-cache\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:51.995821 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:51.995576 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-tmp-dir\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:51.995821 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:51.995664 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-home\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:51.995821 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:51.995724 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq927\" (UniqueName: \"kubernetes.io/projected/e59ed2e1-2c01-4b16-885a-b3535673a642-kube-api-access-bq927\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:51.996011 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:51.995844 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e59ed2e1-2c01-4b16-885a-b3535673a642-tls-certs\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.021303 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.021267 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-795045\"/\"default-dockercfg-8hpdq\"" Nov 04 01:46:52.021303 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.021281 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-795045\"/\"simulator-w1-795045-kserve-self-signed-certs\"" Nov 04 01:46:52.021502 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.021321 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-795045\"/\"openshift-service-ca.crt\"" Nov 04 01:46:52.023038 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.023020 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff"] Nov 04 01:46:52.096877 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.096844 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-dshm\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.096877 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.096880 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-model-cache\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.097122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.096916 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-tmp-dir\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.097122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.096937 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-home\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.097122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.096976 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq927\" (UniqueName: \"kubernetes.io/projected/e59ed2e1-2c01-4b16-885a-b3535673a642-kube-api-access-bq927\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.097122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.097042 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e59ed2e1-2c01-4b16-885a-b3535673a642-tls-certs\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.097409 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.097378 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-home\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.097528 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.097388 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-tmp-dir\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.097528 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.097425 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-model-cache\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.099266 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.099245 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-dshm\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.099598 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.099578 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e59ed2e1-2c01-4b16-885a-b3535673a642-tls-certs\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.157954 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.157924 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq927\" (UniqueName: \"kubernetes.io/projected/e59ed2e1-2c01-4b16-885a-b3535673a642-kube-api-access-bq927\") pod \"simulator-w1-795045-kserve-7cfcd98f86-2g4ff\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.231771 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.231683 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:52.608138 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.607966 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff"] Nov 04 01:46:52.610856 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:46:52.610831 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode59ed2e1_2c01_4b16_885a_b3535673a642.slice/crio-ee367df11010ee95359daf56b75e7399501e92f1d711c0f845030231f064d031 WatchSource:0}: Error finding container ee367df11010ee95359daf56b75e7399501e92f1d711c0f845030231f064d031: Status 404 returned error can't find the container with id ee367df11010ee95359daf56b75e7399501e92f1d711c0f845030231f064d031 Nov 04 01:46:52.878185 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.878098 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" event={"ID":"e59ed2e1-2c01-4b16-885a-b3535673a642","Type":"ContainerStarted","Data":"7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f"} Nov 04 01:46:52.878185 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.878143 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" event={"ID":"e59ed2e1-2c01-4b16-885a-b3535673a642","Type":"ContainerStarted","Data":"ee367df11010ee95359daf56b75e7399501e92f1d711c0f845030231f064d031"} Nov 04 01:46:52.997344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:52.997285 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" podStartSLOduration=1.997272307 podStartE2EDuration="1.997272307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:46:52.996107349 +0000 UTC m=+702.468701641" watchObservedRunningTime="2026-11-04 01:46:52.997272307 +0000 UTC m=+702.469866676" Nov 04 01:46:53.232629 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:53.232542 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:46:54.770333 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.770289 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg"] Nov 04 01:46:54.773654 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.773630 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:54.875163 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.875131 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-82706f\"/\"openshift-service-ca.crt\"" Nov 04 01:46:54.875353 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.875311 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-82706f\"/\"default-dockercfg-r4744\"" Nov 04 01:46:54.875423 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.875354 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-82706f\"/\"kube-root-ca.crt\"" Nov 04 01:46:54.875587 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.875571 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-82706f\"/\"premium-w2-82706f-kserve-self-signed-certs\"" Nov 04 01:46:54.877370 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.877352 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg"] Nov 04 01:46:54.931171 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.928604 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-dshm\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:54.931171 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.928671 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9218427-91b8-49b2-951c-00654714c72f-tls-certs\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:54.931171 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.928709 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg448\" (UniqueName: \"kubernetes.io/projected/c9218427-91b8-49b2-951c-00654714c72f-kube-api-access-kg448\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:54.931171 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.929074 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-tmp-dir\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:54.931171 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.929166 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-home\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:54.931171 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:54.929239 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-model-cache\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.030924 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.030837 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9218427-91b8-49b2-951c-00654714c72f-tls-certs\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.030924 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.030875 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg448\" (UniqueName: \"kubernetes.io/projected/c9218427-91b8-49b2-951c-00654714c72f-kube-api-access-kg448\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.031181 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.031164 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-tmp-dir\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.031243 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.031231 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-home\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.031293 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.031282 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-model-cache\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.031377 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.031362 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-dshm\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.031567 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.031551 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-tmp-dir\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.031645 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.031618 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-home\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.031717 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.031697 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-model-cache\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.033618 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.033598 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-dshm\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.033720 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.033658 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9218427-91b8-49b2-951c-00654714c72f-tls-certs\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.091814 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.091756 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg448\" (UniqueName: \"kubernetes.io/projected/c9218427-91b8-49b2-951c-00654714c72f-kube-api-access-kg448\") pod \"premium-w2-82706f-kserve-64b8b86c9f-k7tsg\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.386490 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.386394 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:46:55.781305 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.781282 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg"] Nov 04 01:46:55.783608 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:46:55.783584 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9218427_91b8_49b2_951c_00654714c72f.slice/crio-638d0bd8890cef3fc389ec7b56a421b23e327d116ed13fc7792becd2b2904746 WatchSource:0}: Error finding container 638d0bd8890cef3fc389ec7b56a421b23e327d116ed13fc7792becd2b2904746: Status 404 returned error can't find the container with id 638d0bd8890cef3fc389ec7b56a421b23e327d116ed13fc7792becd2b2904746 Nov 04 01:46:55.893197 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.893160 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" event={"ID":"c9218427-91b8-49b2-951c-00654714c72f","Type":"ContainerStarted","Data":"0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196"} Nov 04 01:46:55.893197 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:55.893207 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" event={"ID":"c9218427-91b8-49b2-951c-00654714c72f","Type":"ContainerStarted","Data":"638d0bd8890cef3fc389ec7b56a421b23e327d116ed13fc7792becd2b2904746"} Nov 04 01:46:56.012709 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:56.012647 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" podStartSLOduration=2.012629296 podStartE2EDuration="2.012629296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:46:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:46:56.01164972 +0000 UTC m=+705.484244012" watchObservedRunningTime="2026-11-04 01:46:56.012629296 +0000 UTC m=+705.485223589" Nov 04 01:46:56.387208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:46:56.387174 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:47:02.232292 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:02.232249 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:47:02.245141 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:02.245107 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:47:02.939622 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:02.939592 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:47:05.386801 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:05.386738 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:47:05.399206 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:05.399173 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:47:05.955144 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:05.955110 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:47:20.493539 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:47:20.493455 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:47:38.537653 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.537620 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59"] Nov 04 01:47:38.541493 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.541477 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.593853 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.593823 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-82706f-openshift-default-dockercfg-v862d\"" Nov 04 01:47:38.602280 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.602251 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.602365 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.602286 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.602365 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.602302 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.602450 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.602404 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.602450 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.602427 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.602530 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.602480 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.602590 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.602575 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.602634 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.602616 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.602668 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.602642 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhk66\" (UniqueName: \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-kube-api-access-xhk66\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.645366 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.645336 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59"] Nov 04 01:47:38.703404 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703370 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.703580 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703466 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.703580 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703491 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.703580 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703524 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.703580 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703543 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.703741 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703612 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.703741 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703662 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.703741 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703714 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.703912 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703748 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.703912 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703755 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhk66\" (UniqueName: \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-kube-api-access-xhk66\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.703912 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.703844 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.704073 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.704046 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.704133 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.704085 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.704424 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.704398 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.706004 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.705977 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.706273 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.706256 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.766008 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.765976 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.766157 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.766052 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhk66\" (UniqueName: \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-kube-api-access-xhk66\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:38.854298 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:38.854207 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:39.283723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:39.283699 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59"] Nov 04 01:47:39.286216 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:47:39.286179 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee703b6c_80b8_45d2_b63f_db45bea35d5f.slice/crio-98b6159c6ad9f2bcb0acdfa208b776efa54d67d40f87bd12b58fd2357ca7ac2e WatchSource:0}: Error finding container 98b6159c6ad9f2bcb0acdfa208b776efa54d67d40f87bd12b58fd2357ca7ac2e: Status 404 returned error can't find the container with id 98b6159c6ad9f2bcb0acdfa208b776efa54d67d40f87bd12b58fd2357ca7ac2e Nov 04 01:47:39.288547 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:39.288514 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:47:39.288656 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:39.288594 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:47:39.288656 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:39.288639 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:47:40.129835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:40.129800 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" event={"ID":"ee703b6c-80b8-45d2-b63f-db45bea35d5f","Type":"ContainerStarted","Data":"83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0"} Nov 04 01:47:40.130261 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:40.129850 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" event={"ID":"ee703b6c-80b8-45d2-b63f-db45bea35d5f","Type":"ContainerStarted","Data":"98b6159c6ad9f2bcb0acdfa208b776efa54d67d40f87bd12b58fd2357ca7ac2e"} Nov 04 01:47:40.303514 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:40.303461 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" podStartSLOduration=2.30344501 podStartE2EDuration="2.30344501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:47:40.302019675 +0000 UTC m=+749.774613968" watchObservedRunningTime="2026-11-04 01:47:40.30344501 +0000 UTC m=+749.776039301" Nov 04 01:47:40.854807 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:40.854754 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:40.856268 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:40.856246 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 04 01:47:40.856341 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:40.856299 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" podUID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 04 01:47:41.854603 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:41.854564 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 04 01:47:41.855041 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:41.854621 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" podUID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 04 01:47:42.855015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:42.854983 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 04 01:47:42.855437 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:42.855037 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" podUID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 04 01:47:43.854871 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:43.854843 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 04 01:47:43.855212 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:43.855191 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" podUID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 04 01:47:44.854980 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:44.854945 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 04 01:47:44.855164 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:44.854999 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" podUID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 04 01:47:46.769115 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:46.769082 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:46.769646 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:46.769506 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:46.778076 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:47:46.778030 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:47:50.493601 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:47:50.493567 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:48:09.423719 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.423687 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4"] Nov 04 01:48:09.427391 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.427375 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.479629 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.479591 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-f4d202-openshift-default-dockercfg-6vjrk\"" Nov 04 01:48:09.531002 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.530972 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4"] Nov 04 01:48:09.570512 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.570471 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istiod-ca-cert\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.570700 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.570531 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-certs\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.570700 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.570615 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-podinfo\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.570700 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.570655 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-794sv\" (UniqueName: \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-kube-api-access-794sv\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.570700 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.570684 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-token\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.570894 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.570709 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-credential-socket\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.570929 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.570897 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-socket\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.570978 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.570946 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-envoy\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.571050 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.571035 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-data\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.671943 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.671891 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-token\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.671943 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.671946 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-credential-socket\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672185 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672000 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-socket\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672185 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672027 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-envoy\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672185 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672085 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-data\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672185 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672124 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istiod-ca-cert\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672185 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672178 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-certs\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672414 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672202 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-podinfo\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672414 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672395 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-794sv\" (UniqueName: \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-kube-api-access-794sv\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672522 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672425 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-credential-socket\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672522 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672487 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-socket\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672668 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672562 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-certs\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672873 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-data\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.672983 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.672915 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istiod-ca-cert\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.674671 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.674628 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-envoy\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.674830 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.674814 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-podinfo\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.733162 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.733124 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-token\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.733315 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.733265 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-794sv\" (UniqueName: \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-kube-api-access-794sv\") pod \"e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:09.741172 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:09.741151 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:10.168282 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:10.168144 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4"] Nov 04 01:48:10.170539 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:48:10.170510 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6007de_bff5_4127_8cc9_5d0e9301ac4b.slice/crio-44e46fc21772306f055e3f60c950d83f91d71d3da134ca3bce6853bfa5ee4389 WatchSource:0}: Error finding container 44e46fc21772306f055e3f60c950d83f91d71d3da134ca3bce6853bfa5ee4389: Status 404 returned error can't find the container with id 44e46fc21772306f055e3f60c950d83f91d71d3da134ca3bce6853bfa5ee4389 Nov 04 01:48:10.172866 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:10.172835 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:48:10.172965 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:10.172914 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:48:10.173027 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:10.172961 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:48:10.283415 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:10.283379 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" event={"ID":"9b6007de-bff5-4127-8cc9-5d0e9301ac4b","Type":"ContainerStarted","Data":"643d18d9d951b9a66946063d52e0c6173643219976a230dad4f430c4d94232fe"} Nov 04 01:48:10.283566 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:10.283434 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" event={"ID":"9b6007de-bff5-4127-8cc9-5d0e9301ac4b","Type":"ContainerStarted","Data":"44e46fc21772306f055e3f60c950d83f91d71d3da134ca3bce6853bfa5ee4389"} Nov 04 01:48:10.405272 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:10.405208 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" podStartSLOduration=1.405189005 podStartE2EDuration="1.405189005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:48:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:48:10.403146843 +0000 UTC m=+779.875741138" watchObservedRunningTime="2026-11-04 01:48:10.405189005 +0000 UTC m=+779.877783298" Nov 04 01:48:10.741306 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:10.741279 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:11.743364 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:11.743325 5537 patch_prober.go:29] interesting pod/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 04 01:48:11.743878 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:11.743387 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 04 01:48:12.742373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:12.742335 5537 patch_prober.go:29] interesting pod/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 04 01:48:12.742556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:12.742393 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 04 01:48:13.742512 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:13.742478 5537 patch_prober.go:29] interesting pod/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 04 01:48:13.742947 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:13.742533 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 04 01:48:14.741508 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:14.741474 5537 patch_prober.go:29] interesting pod/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 04 01:48:14.741721 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:14.741531 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 04 01:48:15.742180 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:15.742138 5537 patch_prober.go:29] interesting pod/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Nov 04 01:48:15.742852 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:15.742196 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Nov 04 01:48:16.940426 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:16.939097 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:16.940426 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:16.940374 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:16.941449 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:48:16.941427 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:48:20.493126 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:48:20.493088 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:48:50.495152 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:48:50.495074 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:49:20.493484 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:49:20.493445 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:49:32.382526 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.382490 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm"] Nov 04 01:49:32.386122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.386103 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.438730 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.438705 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-c62113-openshift-default-dockercfg-dm8d6\"" Nov 04 01:49:32.487308 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.487268 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-credential-socket\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.487308 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.487312 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-socket\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.487513 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.487407 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-envoy\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.487513 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.487474 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istiod-ca-cert\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.487579 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.487535 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-certs\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.487579 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.487558 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-data\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.487691 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.487676 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-podinfo\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.487728 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.487709 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssvgs\" (UniqueName: \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-kube-api-access-ssvgs\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.487772 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.487742 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-token\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.492837 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.492812 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm"] Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.588589 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-credential-socket\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.588665 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-socket\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.588726 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-envoy\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.588875 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istiod-ca-cert\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.588909 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-certs\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.588932 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-data\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.589048 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-podinfo\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.589087 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssvgs\" (UniqueName: \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-kube-api-access-ssvgs\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.589140 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-token\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.589252 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-credential-socket\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.589510 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-certs\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.589812 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-data\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.589833 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-socket\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.590825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.590816 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istiod-ca-cert\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.609246 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.609189 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-envoy\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.612113 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.612083 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-podinfo\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.653837 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.653738 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-token\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.654936 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.654908 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssvgs\" (UniqueName: \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-kube-api-access-ssvgs\") pod \"e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:32.699833 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:32.699803 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:33.159578 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:33.159467 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm"] Nov 04 01:49:33.162260 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:49:33.162229 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b10fb3d_1f1c_401c_8fdb_78111c45fb94.slice/crio-bc57bac4e96f2fbbaf2268fe583255bbb2641b73a60732fe6a77f286750c1643 WatchSource:0}: Error finding container bc57bac4e96f2fbbaf2268fe583255bbb2641b73a60732fe6a77f286750c1643: Status 404 returned error can't find the container with id bc57bac4e96f2fbbaf2268fe583255bbb2641b73a60732fe6a77f286750c1643 Nov 04 01:49:33.164718 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:33.164688 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:49:33.164822 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:33.164752 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:49:33.164822 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:33.164799 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:49:33.695019 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:33.694979 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" event={"ID":"3b10fb3d-1f1c-401c-8fdb-78111c45fb94","Type":"ContainerStarted","Data":"757520d2df295678638d5fdc08de49b16004c75dae200f8228f3d053d7a64d06"} Nov 04 01:49:33.695453 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:33.695040 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" event={"ID":"3b10fb3d-1f1c-401c-8fdb-78111c45fb94","Type":"ContainerStarted","Data":"bc57bac4e96f2fbbaf2268fe583255bbb2641b73a60732fe6a77f286750c1643"} Nov 04 01:49:33.700290 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:33.700272 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:33.865022 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:33.864925 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" podStartSLOduration=1.86490592 podStartE2EDuration="1.86490592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:49:33.864163128 +0000 UTC m=+863.336757421" watchObservedRunningTime="2026-11-04 01:49:33.86490592 +0000 UTC m=+863.337500215" Nov 04 01:49:34.705530 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:34.705500 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:35.705879 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:35.705846 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:35.707317 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:35.707294 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:49:36.971661 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:36.971617 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2"] Nov 04 01:49:36.972182 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:36.971966 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" containerID="cri-o://ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f" gracePeriod=30 Nov 04 01:49:37.636992 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.636957 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s"] Nov 04 01:49:37.640671 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.640650 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.743013 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.742978 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f4d202\"/\"openshift-service-ca.crt\"" Nov 04 01:49:37.743211 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.743067 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f4d202\"/\"default-dockercfg-2hmgq\"" Nov 04 01:49:37.743211 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.743127 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f4d202\"/\"kube-root-ca.crt\"" Nov 04 01:49:37.745184 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.745162 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s"] Nov 04 01:49:37.745505 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.745491 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f4d202\"/\"distinct-w4-f4d202-kserve-self-signed-certs\"" Nov 04 01:49:37.747012 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.746991 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-dshm\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.747103 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.747026 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-model-cache\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.747153 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.747137 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-home\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.747211 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.747197 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pzkc\" (UniqueName: \"kubernetes.io/projected/cf150306-6aa9-4427-ac21-eeb8c7d72762-kube-api-access-9pzkc\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.747323 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.747307 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf150306-6aa9-4427-ac21-eeb8c7d72762-tls-certs\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.747422 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.747407 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-tmp-dir\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.848408 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.848370 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-home\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.848595 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.848462 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pzkc\" (UniqueName: \"kubernetes.io/projected/cf150306-6aa9-4427-ac21-eeb8c7d72762-kube-api-access-9pzkc\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.848595 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.848538 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf150306-6aa9-4427-ac21-eeb8c7d72762-tls-certs\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.848717 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.848655 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-tmp-dir\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.848770 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.848730 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-dshm\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.848770 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.848757 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-model-cache\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.848963 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.848907 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-home\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.849027 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.849011 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-tmp-dir\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.849118 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.849097 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-model-cache\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.851164 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.851138 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-dshm\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.851430 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.851409 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf150306-6aa9-4427-ac21-eeb8c7d72762-tls-certs\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.909385 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.909313 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pzkc\" (UniqueName: \"kubernetes.io/projected/cf150306-6aa9-4427-ac21-eeb8c7d72762-kube-api-access-9pzkc\") pod \"distinct-w4-f4d202-kserve-775b686f87-f4t2s\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:37.953420 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:37.953374 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:38.358060 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:38.358026 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s"] Nov 04 01:49:38.360121 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:49:38.360090 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf150306_6aa9_4427_ac21_eeb8c7d72762.slice/crio-ca35653115ca7a0b249a274843b374a818ec5ba8a58f59479af4f048b95c6547 WatchSource:0}: Error finding container ca35653115ca7a0b249a274843b374a818ec5ba8a58f59479af4f048b95c6547: Status 404 returned error can't find the container with id ca35653115ca7a0b249a274843b374a818ec5ba8a58f59479af4f048b95c6547 Nov 04 01:49:38.722067 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:38.721977 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" event={"ID":"cf150306-6aa9-4427-ac21-eeb8c7d72762","Type":"ContainerStarted","Data":"87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1"} Nov 04 01:49:38.722067 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:38.722016 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" event={"ID":"cf150306-6aa9-4427-ac21-eeb8c7d72762","Type":"ContainerStarted","Data":"ca35653115ca7a0b249a274843b374a818ec5ba8a58f59479af4f048b95c6547"} Nov 04 01:49:38.838961 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:38.838897 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" podStartSLOduration=1.838882138 podStartE2EDuration="1.838882138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:49:38.838020305 +0000 UTC m=+868.310614601" watchObservedRunningTime="2026-11-04 01:49:38.838882138 +0000 UTC m=+868.311476429" Nov 04 01:49:38.955243 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:38.955208 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:42.233651 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.233620 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:49:42.321119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321083 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-token\" (UniqueName: \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-token\") pod \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " Nov 04 01:49:42.321324 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321145 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-podinfo\") pod \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " Nov 04 01:49:42.321324 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321221 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-socket\") pod \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " Nov 04 01:49:42.321324 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321245 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-kube-api-access-n275c\" (UniqueName: \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-kube-api-access-n275c\") pod \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " Nov 04 01:49:42.321324 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321274 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-certs\") pod \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " Nov 04 01:49:42.321324 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321322 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-data\") pod \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " Nov 04 01:49:42.321580 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321395 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istiod-ca-cert\") pod \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " Nov 04 01:49:42.321580 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321482 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-credential-socket\") pod \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " Nov 04 01:49:42.321580 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321550 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-socket" pod "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" (UID: "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:49:42.321743 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321619 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-envoy\") pod \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\" (UID: \"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d\") " Nov 04 01:49:42.321743 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321625 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-certs" pod "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" (UID: "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:49:42.321886 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321826 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-credential-socket" pod "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" (UID: "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:49:42.321886 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.321872 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-data" pod "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" (UID: "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:49:42.322099 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.322078 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istiod-ca-cert" pod "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" (UID: "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:49:42.322406 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.322367 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:49:42.322406 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.322398 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:49:42.322595 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.322414 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:49:42.322595 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.322429 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:49:42.322595 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.322443 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:49:42.323726 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.323701 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-kube-api-access-n275c" pod "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" (UID: "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d"). InnerVolumeSpecName "kube-api-access-n275c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:49:42.323726 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.323707 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-podinfo" pod "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" (UID: "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:49:42.323726 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.323720 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-token" pod "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" (UID: "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:49:42.323976 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.323960 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-envoy" pod "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" (UID: "3c2d7cf4-b41b-4f81-b6c0-9ccef016210d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:49:42.423835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.423751 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:49:42.423835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.423828 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:49:42.423835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.423845 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:49:42.424078 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.423859 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n275c\" (UniqueName: \"kubernetes.io/projected/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d-kube-api-access-n275c\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:49:42.755922 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.755879 5537 generic.go:356] "Generic (PLEG): container finished" podID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerID="ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f" exitCode=0 Nov 04 01:49:42.756092 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.755928 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" Nov 04 01:49:42.756092 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.755943 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" event={"ID":"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d","Type":"ContainerDied","Data":"ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f"} Nov 04 01:49:42.756092 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.755995 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2" event={"ID":"3c2d7cf4-b41b-4f81-b6c0-9ccef016210d","Type":"ContainerDied","Data":"57516e81447481ec2454c92058f3fe9c1a0d1894c836b66ca5768f7c790ab6df"} Nov 04 01:49:42.756092 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.756019 5537 scope.go:122] "RemoveContainer" containerID="ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f" Nov 04 01:49:42.766897 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.766876 5537 scope.go:122] "RemoveContainer" containerID="ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f" Nov 04 01:49:42.767181 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:49:42.767161 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f\": container with ID starting with ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f not found: ID does not exist" containerID="ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f" Nov 04 01:49:42.767232 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.767191 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f"} err="failed to get container status \"ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f\": rpc error: code = NotFound desc = could not find container \"ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f\": container with ID starting with ef0f9bc358aaa3f2850251797c2db2f038fd6a7eb77a932b007f02b7b01cac8f not found: ID does not exist" Nov 04 01:49:42.921135 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.921051 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2"] Nov 04 01:49:42.970209 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:42.970178 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-hs2x2"] Nov 04 01:49:44.643709 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:44.643664 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" path="/var/lib/kubelet/pods/3c2d7cf4-b41b-4f81-b6c0-9ccef016210d/volumes" Nov 04 01:49:47.954383 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:47.954346 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:47.967238 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:47.967212 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:48.797262 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:49:48.797234 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:49:50.493271 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:49:50.493231 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:50:06.570546 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.570506 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c"] Nov 04 01:50:06.571082 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.570934 5537 cpu_manager.go:414] "containerMap: removing container" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" Nov 04 01:50:06.571082 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.570957 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" Nov 04 01:50:06.571082 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.571051 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c2d7cf4-b41b-4f81-b6c0-9ccef016210d" containerName="istio-proxy" Nov 04 01:50:06.574182 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.574166 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.596642 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.596617 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-home\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.596814 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.596673 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8dvw\" (UniqueName: \"kubernetes.io/projected/681d7509-57cd-477f-93c3-5dbc97f711d2-kube-api-access-s8dvw\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.596889 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.596852 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-tmp-dir\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.596985 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.596967 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-dshm\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.597054 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.597039 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-model-cache\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.597109 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.597074 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681d7509-57cd-477f-93c3-5dbc97f711d2-tls-certs\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.675587 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.675558 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7af38e\"/\"distinct-w0-7af38e-kserve-self-signed-certs\"" Nov 04 01:50:06.677587 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.677567 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c"] Nov 04 01:50:06.697881 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.697852 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-home\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.698065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.697897 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8dvw\" (UniqueName: \"kubernetes.io/projected/681d7509-57cd-477f-93c3-5dbc97f711d2-kube-api-access-s8dvw\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.698065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.697944 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-tmp-dir\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.698065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.697982 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-dshm\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.698065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.698035 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-model-cache\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.698065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.698054 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681d7509-57cd-477f-93c3-5dbc97f711d2-tls-certs\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.698383 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.698362 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-home\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.698441 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.698384 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-tmp-dir\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.698476 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.698444 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-model-cache\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.700417 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.700393 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-dshm\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.700688 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.700671 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681d7509-57cd-477f-93c3-5dbc97f711d2-tls-certs\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.759105 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.759067 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8dvw\" (UniqueName: \"kubernetes.io/projected/681d7509-57cd-477f-93c3-5dbc97f711d2-kube-api-access-s8dvw\") pod \"distinct-w0-7af38e-kserve-6c6648b657-m2w8c\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:06.885701 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:06.885614 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:07.292109 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:07.292047 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c"] Nov 04 01:50:07.294490 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:50:07.294465 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod681d7509_57cd_477f_93c3_5dbc97f711d2.slice/crio-d8dd36166d4b7b69575e5d064af2496687d3acd7ec5a0741208fd0960f092b64 WatchSource:0}: Error finding container d8dd36166d4b7b69575e5d064af2496687d3acd7ec5a0741208fd0960f092b64: Status 404 returned error can't find the container with id d8dd36166d4b7b69575e5d064af2496687d3acd7ec5a0741208fd0960f092b64 Nov 04 01:50:07.886896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:07.886861 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" event={"ID":"681d7509-57cd-477f-93c3-5dbc97f711d2","Type":"ContainerStarted","Data":"f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145"} Nov 04 01:50:07.887339 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:07.886909 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" event={"ID":"681d7509-57cd-477f-93c3-5dbc97f711d2","Type":"ContainerStarted","Data":"d8dd36166d4b7b69575e5d064af2496687d3acd7ec5a0741208fd0960f092b64"} Nov 04 01:50:08.005533 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:08.005474 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" podStartSLOduration=2.005458462 podStartE2EDuration="2.005458462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:50:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:50:08.004533828 +0000 UTC m=+897.477128124" watchObservedRunningTime="2026-11-04 01:50:08.005458462 +0000 UTC m=+897.478052753" Nov 04 01:50:08.886536 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:08.886499 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:16.886619 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:16.886591 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:16.899106 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:16.899080 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:16.970588 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:16.970553 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:50:20.510707 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:50:20.510535 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:50:25.983236 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:25.983205 5537 generic.go:356] "Generic (PLEG): container finished" podID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerID="757520d2df295678638d5fdc08de49b16004c75dae200f8228f3d053d7a64d06" exitCode=0 Nov 04 01:50:25.983699 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:25.983285 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" event={"ID":"3b10fb3d-1f1c-401c-8fdb-78111c45fb94","Type":"ContainerDied","Data":"757520d2df295678638d5fdc08de49b16004c75dae200f8228f3d053d7a64d06"} Nov 04 01:50:25.983746 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:25.983710 5537 scope.go:122] "RemoveContainer" containerID="757520d2df295678638d5fdc08de49b16004c75dae200f8228f3d053d7a64d06" Nov 04 01:50:25.985112 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:25.985082 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:50:25.985228 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:25.985169 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:50:25.985228 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:25.985221 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:50:26.991349 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:26.991319 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" event={"ID":"3b10fb3d-1f1c-401c-8fdb-78111c45fb94","Type":"ContainerStarted","Data":"9132713a4b2bce2c6df93b6d382f91de7bf859fae16400a9967fd7e52766f543"} Nov 04 01:50:27.700571 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:27.700540 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:50:27.700764 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:27.700656 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 04 01:50:27.700764 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:27.700708 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 04 01:50:28.700452 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:28.700414 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 04 01:50:28.700892 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:28.700472 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 04 01:50:29.700609 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:29.700574 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 04 01:50:29.701018 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:29.700627 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 04 01:50:30.701131 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:30.701096 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 04 01:50:30.701514 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:30.701165 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 04 01:50:31.701135 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:31.701103 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 04 01:50:31.701554 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:31.701176 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 04 01:50:32.704433 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:32.704403 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:50:32.704944 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:32.704812 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:50:32.705609 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:32.705591 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:50:50.311220 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.311179 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w"] Nov 04 01:50:50.313934 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.313912 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.372804 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.369006 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-c2cde5-openshift-default-dockercfg-l8tjs\"" Nov 04 01:50:50.433729 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.433694 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w"] Nov 04 01:50:50.490955 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.490891 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-data\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.491333 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.491311 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-credential-socket\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.491510 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.491494 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6zpd\" (UniqueName: \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-kube-api-access-k6zpd\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.491704 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.491688 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07aaebde-805e-4089-bca0-a58bd396fe97-istiod-ca-cert\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.491898 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.491881 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07aaebde-805e-4089-bca0-a58bd396fe97-istio-podinfo\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.492075 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.492060 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-envoy\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.492240 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.492218 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-istio-token\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.492445 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.492428 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-socket\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.492597 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.492581 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-certs\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.515606 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:50:50.515568 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:50:50.597497 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.597185 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07aaebde-805e-4089-bca0-a58bd396fe97-istiod-ca-cert\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.597749 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.597718 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07aaebde-805e-4089-bca0-a58bd396fe97-istio-podinfo\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.598010 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.597992 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-envoy\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.601082 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-istio-token\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.601209 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-socket\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.601243 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-certs\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.601326 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-data\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.601432 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-credential-socket\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.601467 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6zpd\" (UniqueName: \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-kube-api-access-k6zpd\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.601558 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07aaebde-805e-4089-bca0-a58bd396fe97-istiod-ca-cert\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.601831 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-certs\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.602063 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-data\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.602107 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-socket\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.602344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.602297 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-credential-socket\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.608252 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.608219 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-envoy\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.609279 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.609256 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07aaebde-805e-4089-bca0-a58bd396fe97-istio-podinfo\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.661097 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.661060 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-istio-token\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.661692 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.661672 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6zpd\" (UniqueName: \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-kube-api-access-k6zpd\") pod \"e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:50.925362 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:50.925277 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:51.352516 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:51.352487 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w"] Nov 04 01:50:51.354741 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:50:51.354713 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07aaebde_805e_4089_bca0_a58bd396fe97.slice/crio-2a949c16785be45672a0f97910706260f4b1e19b7b5338d635143183503c9fc7 WatchSource:0}: Error finding container 2a949c16785be45672a0f97910706260f4b1e19b7b5338d635143183503c9fc7: Status 404 returned error can't find the container with id 2a949c16785be45672a0f97910706260f4b1e19b7b5338d635143183503c9fc7 Nov 04 01:50:51.357215 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:51.357180 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:50:51.357290 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:51.357248 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:50:51.357290 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:51.357281 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:50:52.132555 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:52.132513 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" event={"ID":"07aaebde-805e-4089-bca0-a58bd396fe97","Type":"ContainerStarted","Data":"78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e"} Nov 04 01:50:52.132735 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:52.132568 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" event={"ID":"07aaebde-805e-4089-bca0-a58bd396fe97","Type":"ContainerStarted","Data":"2a949c16785be45672a0f97910706260f4b1e19b7b5338d635143183503c9fc7"} Nov 04 01:50:52.303542 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:52.303494 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" podStartSLOduration=2.303480448 podStartE2EDuration="2.303480448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:50:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:50:52.30127103 +0000 UTC m=+941.773865314" watchObservedRunningTime="2026-11-04 01:50:52.303480448 +0000 UTC m=+941.776074739" Nov 04 01:50:52.925829 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:52.925762 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:52.931390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:52.931366 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:53.137601 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:53.137576 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:50:53.138414 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:50:53.138396 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:51:10.750909 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.750872 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn"] Nov 04 01:51:10.756315 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.755438 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.771716 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.771684 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-home\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.771716 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.771714 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-model-cache\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.771928 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.771730 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-dshm\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.771928 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.771832 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tls-certs\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.772044 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.772019 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xll9\" (UniqueName: \"kubernetes.io/projected/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-kube-api-access-6xll9\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.772099 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.772056 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tmp-dir\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.811839 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.811806 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn"] Nov 04 01:51:10.858305 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.858270 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f4d202\"/\"distinct-2-w4-f4d202-kserve-self-signed-certs\"" Nov 04 01:51:10.872879 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.872847 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xll9\" (UniqueName: \"kubernetes.io/projected/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-kube-api-access-6xll9\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.873064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.872884 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tmp-dir\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.873064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.872946 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-home\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.873064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.872961 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-model-cache\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.873064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.872978 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-dshm\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.873064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.873015 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tls-certs\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.873345 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.873324 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tmp-dir\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.873419 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.873377 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-model-cache\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.873419 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.873400 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-home\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.876164 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.876139 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-dshm\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.876359 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.876344 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tls-certs\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:10.933902 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:10.933870 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xll9\" (UniqueName: \"kubernetes.io/projected/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-kube-api-access-6xll9\") pod \"distinct-2-w4-f4d202-kserve-df58d9f6-xfppn\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:11.069384 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:11.069292 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:11.484403 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:11.484379 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn"] Nov 04 01:51:11.486461 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:51:11.486423 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c80f6b7_1b85_4068_a246_f3e2b3be5e8f.slice/crio-03f60520e63bac1111e955df15f759710d901c4639da3588d0a60efc41d5deb6 WatchSource:0}: Error finding container 03f60520e63bac1111e955df15f759710d901c4639da3588d0a60efc41d5deb6: Status 404 returned error can't find the container with id 03f60520e63bac1111e955df15f759710d901c4639da3588d0a60efc41d5deb6 Nov 04 01:51:12.233954 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:12.233918 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" event={"ID":"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f","Type":"ContainerStarted","Data":"71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94"} Nov 04 01:51:12.234401 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:12.233965 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" event={"ID":"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f","Type":"ContainerStarted","Data":"03f60520e63bac1111e955df15f759710d901c4639da3588d0a60efc41d5deb6"} Nov 04 01:51:12.351469 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:12.351414 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" podStartSLOduration=2.3513983290000002 podStartE2EDuration="2.351398329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:51:12.350008762 +0000 UTC m=+961.822603054" watchObservedRunningTime="2026-11-04 01:51:12.351398329 +0000 UTC m=+961.823992662" Nov 04 01:51:13.069988 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:13.069952 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:20.510068 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:51:20.510020 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:51:21.069749 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:21.069710 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:21.082328 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:21.082299 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:21.300239 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:21.300211 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:51:27.545553 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.545515 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz"] Nov 04 01:51:27.549413 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.549390 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.650874 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.650834 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7af38e\"/\"distinct-2-w0-7af38e-kserve-self-signed-certs\"" Nov 04 01:51:27.653018 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.652995 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz"] Nov 04 01:51:27.660355 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.660330 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-home\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.660435 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.660404 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-model-cache\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.660504 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.660490 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tmp-dir\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.660550 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.660538 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ztfs\" (UniqueName: \"kubernetes.io/projected/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-kube-api-access-4ztfs\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.660637 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.660618 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-dshm\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.660672 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.660660 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tls-certs\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.761573 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.761541 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ztfs\" (UniqueName: \"kubernetes.io/projected/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-kube-api-access-4ztfs\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.761573 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.761586 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-dshm\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.761864 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.761617 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tls-certs\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.761864 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.761676 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-home\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.761864 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.761734 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-model-cache\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.761864 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.761812 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tmp-dir\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.762165 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.762138 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-home\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.762246 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.762173 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tmp-dir\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.762246 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.762233 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-model-cache\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.764114 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.764093 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-dshm\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.764257 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.764227 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tls-certs\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.824827 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.824737 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ztfs\" (UniqueName: \"kubernetes.io/projected/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-kube-api-access-4ztfs\") pod \"distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:27.861737 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:27.861702 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:28.273705 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:28.273673 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz"] Nov 04 01:51:28.275953 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:51:28.275923 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8ab42c2_ad8d_4e7e_92d6_9451a175c7a9.slice/crio-1d5a93f7b82e46666a5ddedf2aa300844975ac3bbe1317ebf28bfc7d7140b066 WatchSource:0}: Error finding container 1d5a93f7b82e46666a5ddedf2aa300844975ac3bbe1317ebf28bfc7d7140b066: Status 404 returned error can't find the container with id 1d5a93f7b82e46666a5ddedf2aa300844975ac3bbe1317ebf28bfc7d7140b066 Nov 04 01:51:28.336930 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:28.336900 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" event={"ID":"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9","Type":"ContainerStarted","Data":"1d5a93f7b82e46666a5ddedf2aa300844975ac3bbe1317ebf28bfc7d7140b066"} Nov 04 01:51:29.343721 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:29.343681 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" event={"ID":"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9","Type":"ContainerStarted","Data":"e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464"} Nov 04 01:51:29.459859 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:29.459745 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" podStartSLOduration=2.45973075 podStartE2EDuration="2.45973075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:51:29.459437423 +0000 UTC m=+978.932031706" watchObservedRunningTime="2026-11-04 01:51:29.45973075 +0000 UTC m=+978.932325041" Nov 04 01:51:29.861887 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:29.861851 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:37.861851 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:37.861820 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:37.879837 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:37.879810 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:38.402798 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:38.402749 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:51:50.495136 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:51:50.495037 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:51:59.528128 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:59.528092 5537 generic.go:356] "Generic (PLEG): container finished" podID="07aaebde-805e-4089-bca0-a58bd396fe97" containerID="78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e" exitCode=0 Nov 04 01:51:59.528597 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:59.528180 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" event={"ID":"07aaebde-805e-4089-bca0-a58bd396fe97","Type":"ContainerDied","Data":"78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e"} Nov 04 01:51:59.528597 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:59.528569 5537 scope.go:122] "RemoveContainer" containerID="78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e" Nov 04 01:51:59.529931 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:59.529905 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:51:59.530008 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:59.529973 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:51:59.530008 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:51:59.530004 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:00.535317 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:00.535286 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" event={"ID":"07aaebde-805e-4089-bca0-a58bd396fe97","Type":"ContainerStarted","Data":"6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92"} Nov 04 01:52:00.925764 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:00.925681 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:52:00.925951 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:00.925860 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Nov 04 01:52:00.925951 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:00.925915 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Nov 04 01:52:01.926384 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:01.926350 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Nov 04 01:52:01.926842 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:01.926404 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Nov 04 01:52:02.926319 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:02.926279 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Nov 04 01:52:02.926508 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:02.926335 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Nov 04 01:52:03.926235 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:03.926194 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Nov 04 01:52:03.926571 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:03.926543 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Nov 04 01:52:04.925885 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:04.925849 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Nov 04 01:52:04.926040 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:04.925913 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Nov 04 01:52:05.926065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:05.926021 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Nov 04 01:52:05.926477 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:05.926099 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Nov 04 01:52:06.930658 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:06.930631 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:52:06.931092 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:06.931028 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:52:06.931774 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:06.931754 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:52:15.532896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.532860 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt"] Nov 04 01:52:15.536135 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.536117 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.589012 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.588983 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-c0ab5f-openshift-default-dockercfg-wf4h2\"" Nov 04 01:52:15.614307 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.614271 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-podinfo\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.614508 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.614315 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x68l\" (UniqueName: \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-kube-api-access-6x68l\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.614508 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.614403 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-envoy\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.614508 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.614440 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-token\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.614508 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.614492 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-socket\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.614724 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.614546 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-credential-socket\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.614724 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.614634 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-data\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.614724 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.614680 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-certs\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.614932 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.614724 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istiod-ca-cert\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.655863 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.655749 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt"] Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.716686 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-credential-socket\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.716807 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-data\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.716857 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-certs\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.716896 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istiod-ca-cert\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.716959 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-podinfo\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.716983 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x68l\" (UniqueName: \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-kube-api-access-6x68l\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.717075 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-envoy\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.717117 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-token\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.717183 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-socket\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.717710 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-socket\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.718452 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-credential-socket\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.718683 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-data\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.718921 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-certs\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.726808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.719606 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istiod-ca-cert\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.737889 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.737858 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-envoy\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.746878 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.746847 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-podinfo\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.786200 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.786127 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-token\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.786612 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.786584 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x68l\" (UniqueName: \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-kube-api-access-6x68l\") pod \"e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:15.848083 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:15.848054 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:16.276704 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:16.276673 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt"] Nov 04 01:52:16.278478 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:52:16.278453 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522a1ef4_7857_445b_94e0_bfa71bdf42e8.slice/crio-415d516f8d4234409485fad49ad2712e8dcdebf7e6310023409a3b4db131f282 WatchSource:0}: Error finding container 415d516f8d4234409485fad49ad2712e8dcdebf7e6310023409a3b4db131f282: Status 404 returned error can't find the container with id 415d516f8d4234409485fad49ad2712e8dcdebf7e6310023409a3b4db131f282 Nov 04 01:52:16.281041 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:16.281009 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:16.281113 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:16.281078 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:16.281113 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:16.281108 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:16.649049 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:16.648963 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" event={"ID":"522a1ef4-7857-445b-94e0-bfa71bdf42e8","Type":"ContainerStarted","Data":"c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755"} Nov 04 01:52:16.649049 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:16.649019 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" event={"ID":"522a1ef4-7857-445b-94e0-bfa71bdf42e8","Type":"ContainerStarted","Data":"415d516f8d4234409485fad49ad2712e8dcdebf7e6310023409a3b4db131f282"} Nov 04 01:52:16.771029 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:16.770974 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" podStartSLOduration=1.770954098 podStartE2EDuration="1.770954098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:52:16.768402945 +0000 UTC m=+1026.240997239" watchObservedRunningTime="2026-11-04 01:52:16.770954098 +0000 UTC m=+1026.243548384" Nov 04 01:52:16.848921 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:16.848890 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:17.855989 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:17.855960 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:18.659863 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:18.659834 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:18.660954 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:18.660935 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:52:20.492938 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:52:20.492899 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:52:23.348080 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.348042 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd"] Nov 04 01:52:23.350639 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.350619 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.417354 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.417319 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc18872f-d1f9-4510-950e-16a9d7c994b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.417552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.417394 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.417552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.417476 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.417552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.417503 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.417716 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.417615 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.417716 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.417665 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.417716 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.417683 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgv5p\" (UniqueName: \"kubernetes.io/projected/bc18872f-d1f9-4510-950e-16a9d7c994b9-kube-api-access-dgv5p\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.417716 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.417701 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.417941 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.417810 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.455741 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.455705 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd"] Nov 04 01:52:23.518467 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.518434 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.518667 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.518480 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.518667 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.518498 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgv5p\" (UniqueName: \"kubernetes.io/projected/bc18872f-d1f9-4510-950e-16a9d7c994b9-kube-api-access-dgv5p\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.518667 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.518528 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.518667 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.518577 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.518951 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.518710 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc18872f-d1f9-4510-950e-16a9d7c994b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.518951 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.518844 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.518951 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.518928 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.519091 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.518956 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.519091 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.518964 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.519091 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.519000 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.519344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.519321 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.519585 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.519528 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.519734 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.519671 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc18872f-d1f9-4510-950e-16a9d7c994b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.521191 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.521171 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.521283 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.521207 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.579659 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.579632 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgv5p\" (UniqueName: \"kubernetes.io/projected/bc18872f-d1f9-4510-950e-16a9d7c994b9-kube-api-access-dgv5p\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.579816 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.579664 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc18872f-d1f9-4510-950e-16a9d7c994b9-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-p7nkd\" (UID: \"bc18872f-d1f9-4510-950e-16a9d7c994b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:23.664215 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:23.664138 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:24.135544 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:24.135520 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd"] Nov 04 01:52:24.137890 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:52:24.137849 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc18872f_d1f9_4510_950e_16a9d7c994b9.slice/crio-398c8c38626da70b52bd7af6f0230b6fc48badadb39824a6ec67f132c0adab30 WatchSource:0}: Error finding container 398c8c38626da70b52bd7af6f0230b6fc48badadb39824a6ec67f132c0adab30: Status 404 returned error can't find the container with id 398c8c38626da70b52bd7af6f0230b6fc48badadb39824a6ec67f132c0adab30 Nov 04 01:52:24.140206 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:24.140177 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:24.140270 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:24.140243 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:24.140309 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:24.140271 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:24.703202 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:24.703153 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" event={"ID":"bc18872f-d1f9-4510-950e-16a9d7c994b9","Type":"ContainerStarted","Data":"5cc9fe14f58baae92ab2bf7be0c049dbd1ca6b37ddac8802151216ba34f05a05"} Nov 04 01:52:24.703614 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:24.703227 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" event={"ID":"bc18872f-d1f9-4510-950e-16a9d7c994b9","Type":"ContainerStarted","Data":"398c8c38626da70b52bd7af6f0230b6fc48badadb39824a6ec67f132c0adab30"} Nov 04 01:52:25.683207 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.683170 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:25.685654 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.685627 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-p7nkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Nov 04 01:52:25.685823 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.685689 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" podUID="bc18872f-d1f9-4510-950e-16a9d7c994b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Nov 04 01:52:25.784983 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.784930 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" podStartSLOduration=2.7849138780000002 podStartE2EDuration="2.784913878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:52:24.880241074 +0000 UTC m=+1034.352835367" watchObservedRunningTime="2026-11-04 01:52:25.784913878 +0000 UTC m=+1035.257508170" Nov 04 01:52:25.786488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.786460 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn"] Nov 04 01:52:25.790654 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.790634 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.888352 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.888308 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn"] Nov 04 01:52:25.888649 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.888502 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.888903 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.888883 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a394a024-f25d-474b-aff6-0f4194bf0659-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.889135 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.889100 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.889502 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.889455 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.889789 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.889760 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a394a024-f25d-474b-aff6-0f4194bf0659-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.889937 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.889857 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.889937 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.889889 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.890036 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.890010 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vp7\" (UniqueName: \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-kube-api-access-s7vp7\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.890102 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.890076 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.991668 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.991570 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a394a024-f25d-474b-aff6-0f4194bf0659-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.991668 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.991654 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.991925 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.991691 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.991925 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.991800 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a394a024-f25d-474b-aff6-0f4194bf0659-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.991925 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.991863 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.991925 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.991887 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.992149 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.991931 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vp7\" (UniqueName: \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-kube-api-access-s7vp7\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.992149 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.991968 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.992149 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.992015 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.992420 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.992398 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.992818 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.992668 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.992936 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.992819 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a394a024-f25d-474b-aff6-0f4194bf0659-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.993006 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.992971 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.993399 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.993371 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.995070 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.995034 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:25.998419 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:25.998396 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a394a024-f25d-474b-aff6-0f4194bf0659-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:26.052625 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.052590 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:26.052838 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.052707 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vp7\" (UniqueName: \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-kube-api-access-s7vp7\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:26.107487 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.107454 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:26.582807 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.581965 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn"] Nov 04 01:52:26.587915 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:52:26.587885 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda394a024_f25d_474b_aff6_0f4194bf0659.slice/crio-ee1a0111b434747ca023f9e9a271c4b3a2ffee0187a40c816cbc3ec59b0bd9dc WatchSource:0}: Error finding container ee1a0111b434747ca023f9e9a271c4b3a2ffee0187a40c816cbc3ec59b0bd9dc: Status 404 returned error can't find the container with id ee1a0111b434747ca023f9e9a271c4b3a2ffee0187a40c816cbc3ec59b0bd9dc Nov 04 01:52:26.590417 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.590383 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:26.590497 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.590451 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:26.590497 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.590480 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:26.684008 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.683892 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-p7nkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Nov 04 01:52:26.684008 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.683949 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" podUID="bc18872f-d1f9-4510-950e-16a9d7c994b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Nov 04 01:52:26.717296 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.717256 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" event={"ID":"a394a024-f25d-474b-aff6-0f4194bf0659","Type":"ContainerStarted","Data":"556f608ef1224937ed076e551085c284606ff2d52265436c9a07f5524f389a06"} Nov 04 01:52:26.717440 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.717318 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" event={"ID":"a394a024-f25d-474b-aff6-0f4194bf0659","Type":"ContainerStarted","Data":"ee1a0111b434747ca023f9e9a271c4b3a2ffee0187a40c816cbc3ec59b0bd9dc"} Nov 04 01:52:26.839120 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:26.839006 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" podStartSLOduration=1.838992088 podStartE2EDuration="1.838992088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:52:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:52:26.837194721 +0000 UTC m=+1036.309789015" watchObservedRunningTime="2026-11-04 01:52:26.838992088 +0000 UTC m=+1036.311586381" Nov 04 01:52:27.107768 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:27.107682 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:27.109682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:27.109652 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Nov 04 01:52:27.109854 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:27.109711 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Nov 04 01:52:27.678808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:27.667244 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-p7nkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Nov 04 01:52:27.678808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:27.667303 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" podUID="bc18872f-d1f9-4510-950e-16a9d7c994b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Nov 04 01:52:28.177679 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:28.111353 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Nov 04 01:52:28.177679 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:28.111409 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Nov 04 01:52:28.680809 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:28.679967 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-p7nkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Nov 04 01:52:28.680809 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:28.680024 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" podUID="bc18872f-d1f9-4510-950e-16a9d7c994b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Nov 04 01:52:29.108757 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:29.108306 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Nov 04 01:52:29.108757 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:29.108370 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Nov 04 01:52:29.676806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:29.666235 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-p7nkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Nov 04 01:52:29.676806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:29.666307 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" podUID="bc18872f-d1f9-4510-950e-16a9d7c994b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Nov 04 01:52:30.110825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:30.109193 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Nov 04 01:52:30.110825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:30.109255 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Nov 04 01:52:30.671896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:30.670140 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-p7nkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Nov 04 01:52:30.671896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:30.670209 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" podUID="bc18872f-d1f9-4510-950e-16a9d7c994b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Nov 04 01:52:31.108074 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:31.108042 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Nov 04 01:52:31.108614 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:31.108101 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Nov 04 01:52:31.668808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:31.666195 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-p7nkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Nov 04 01:52:31.668808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:31.666258 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" podUID="bc18872f-d1f9-4510-950e-16a9d7c994b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Nov 04 01:52:32.108254 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:32.108218 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Nov 04 01:52:32.108745 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:32.108281 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Nov 04 01:52:32.675807 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:32.674217 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-p7nkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Nov 04 01:52:32.675807 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:32.674285 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" podUID="bc18872f-d1f9-4510-950e-16a9d7c994b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Nov 04 01:52:33.108454 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:33.108413 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Nov 04 01:52:33.108883 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:33.108483 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Nov 04 01:52:33.742178 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:33.742149 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:33.742625 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:33.742593 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:33.744432 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:33.744408 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-p7nkd" Nov 04 01:52:34.301495 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:34.301458 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:34.302006 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:34.301814 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:34.302580 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:34.302554 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:52:37.173315 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:37.173282 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn"] Nov 04 01:52:37.222762 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:37.222725 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s"] Nov 04 01:52:38.500100 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.500071 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr"] Nov 04 01:52:38.504117 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.504099 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.583446 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.583415 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.583641 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.583458 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.583641 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.583609 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.583769 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.583646 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/954d94ff-3308-4877-a781-e7f71513df5f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.583858 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.583770 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/954d94ff-3308-4877-a781-e7f71513df5f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.583958 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.583937 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.584084 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.584065 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24n9m\" (UniqueName: \"kubernetes.io/projected/954d94ff-3308-4877-a781-e7f71513df5f-kube-api-access-24n9m\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.584169 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.584095 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/954d94ff-3308-4877-a781-e7f71513df5f-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.584169 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.584147 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.685646 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.685605 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.685880 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.685688 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.685880 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.685724 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686019 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.685880 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686019 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.685904 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/954d94ff-3308-4877-a781-e7f71513df5f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686019 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.685958 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/954d94ff-3308-4877-a781-e7f71513df5f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686019 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.686004 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686207 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.686073 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686207 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.686094 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686207 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.686118 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24n9m\" (UniqueName: \"kubernetes.io/projected/954d94ff-3308-4877-a781-e7f71513df5f-kube-api-access-24n9m\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686207 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.686150 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/954d94ff-3308-4877-a781-e7f71513df5f-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686577 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.686551 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686978 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.686744 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.686978 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.686919 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/954d94ff-3308-4877-a781-e7f71513df5f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.688256 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.688229 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/954d94ff-3308-4877-a781-e7f71513df5f-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.688771 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.688748 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/954d94ff-3308-4877-a781-e7f71513df5f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.714296 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.714270 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr"] Nov 04 01:52:38.747320 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.747279 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/954d94ff-3308-4877-a781-e7f71513df5f-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.747500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.747402 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24n9m\" (UniqueName: \"kubernetes.io/projected/954d94ff-3308-4877-a781-e7f71513df5f-kube-api-access-24n9m\") pod \"maas-default-gateway-openshift-default-778b7b5c47-nwszr\" (UID: \"954d94ff-3308-4877-a781-e7f71513df5f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:38.817735 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:38.817644 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:39.250272 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:39.250245 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr"] Nov 04 01:52:39.286960 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:52:39.286927 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954d94ff_3308_4877_a781_e7f71513df5f.slice/crio-b4b6974759f08b895035562c505d4af9bf65fdbbb3980b801d45b3be0a13b5ed WatchSource:0}: Error finding container b4b6974759f08b895035562c505d4af9bf65fdbbb3980b801d45b3be0a13b5ed: Status 404 returned error can't find the container with id b4b6974759f08b895035562c505d4af9bf65fdbbb3980b801d45b3be0a13b5ed Nov 04 01:52:39.289495 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:39.289463 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:39.289592 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:39.289546 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:39.289592 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:39.289573 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:39.807495 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:39.807460 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" event={"ID":"954d94ff-3308-4877-a781-e7f71513df5f","Type":"ContainerStarted","Data":"6928ea131bf0b7cf76c9dea7ca461de8ba6dd67080f576536c2a3c79e761f2ed"} Nov 04 01:52:39.807922 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:39.807519 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" event={"ID":"954d94ff-3308-4877-a781-e7f71513df5f","Type":"ContainerStarted","Data":"b4b6974759f08b895035562c505d4af9bf65fdbbb3980b801d45b3be0a13b5ed"} Nov 04 01:52:39.818178 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:39.818128 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:39.932014 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:39.931962 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" podStartSLOduration=1.931947761 podStartE2EDuration="1.931947761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:52:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:52:39.928516592 +0000 UTC m=+1049.401110896" watchObservedRunningTime="2026-11-04 01:52:39.931947761 +0000 UTC m=+1049.404542066" Nov 04 01:52:40.501453 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.501417 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc"] Nov 04 01:52:40.505191 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.505175 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.587801 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.583260 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-79badd-openshift-default-dockercfg-ww975\"" Nov 04 01:52:40.821904 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.815749 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc"] Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.825034 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89a932f5-c594-4ca1-9f76-6551146d4209-istio-podinfo\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.825096 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97gms\" (UniqueName: \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-kube-api-access-97gms\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.825139 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-socket\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.825163 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89a932f5-c594-4ca1-9f76-6551146d4209-istiod-ca-cert\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.825216 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-certs\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.825287 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-istio-token\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.825320 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-credential-socket\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.825448 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-data\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.825508 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-envoy\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.828141 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-nwszr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Nov 04 01:52:40.829848 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.828201 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" podUID="954d94ff-3308-4877-a781-e7f71513df5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Nov 04 01:52:40.940819 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.940764 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-istio-token\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.940849 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-credential-socket\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.940961 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-data\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941103 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.941037 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-envoy\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941154 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.941123 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89a932f5-c594-4ca1-9f76-6551146d4209-istio-podinfo\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941191 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.941174 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-credential-socket\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941235 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.941186 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97gms\" (UniqueName: \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-kube-api-access-97gms\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941271 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.941230 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-socket\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941271 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.941251 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89a932f5-c594-4ca1-9f76-6551146d4209-istiod-ca-cert\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941337 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.941298 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-certs\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941683 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.941668 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-socket\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.941930 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.941911 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-data\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.942244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.942219 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-certs\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.942614 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.942584 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89a932f5-c594-4ca1-9f76-6551146d4209-istiod-ca-cert\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.944705 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.944678 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-envoy\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:40.946406 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:40.946384 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89a932f5-c594-4ca1-9f76-6551146d4209-istio-podinfo\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:41.004049 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.004007 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-istio-token\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:41.004209 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.004086 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97gms\" (UniqueName: \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-kube-api-access-97gms\") pod \"e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:41.122569 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.122483 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:41.586326 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.586143 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc"] Nov 04 01:52:41.589599 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:52:41.589475 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a932f5_c594_4ca1_9f76_6551146d4209.slice/crio-020bf015521799a2c728fd9b0676ed06188281683b4fb715e8a5916733aee13f WatchSource:0}: Error finding container 020bf015521799a2c728fd9b0676ed06188281683b4fb715e8a5916733aee13f: Status 404 returned error can't find the container with id 020bf015521799a2c728fd9b0676ed06188281683b4fb715e8a5916733aee13f Nov 04 01:52:41.592288 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.592254 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:41.592375 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.592320 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:41.592375 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.592352 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:52:41.818047 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.818013 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-nwszr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Nov 04 01:52:41.818231 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.818067 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" podUID="954d94ff-3308-4877-a781-e7f71513df5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Nov 04 01:52:41.845431 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.845324 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" event={"ID":"89a932f5-c594-4ca1-9f76-6551146d4209","Type":"ContainerStarted","Data":"4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e"} Nov 04 01:52:41.845431 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.845387 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" event={"ID":"89a932f5-c594-4ca1-9f76-6551146d4209","Type":"ContainerStarted","Data":"020bf015521799a2c728fd9b0676ed06188281683b4fb715e8a5916733aee13f"} Nov 04 01:52:41.982806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:41.982322 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" podStartSLOduration=1.982300797 podStartE2EDuration="1.982300797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:52:41.982119419 +0000 UTC m=+1051.454713713" watchObservedRunningTime="2026-11-04 01:52:41.982300797 +0000 UTC m=+1051.454895086" Nov 04 01:52:42.129855 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:42.126761 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:42.143192 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:42.143154 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:42.821810 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:42.821325 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-nwszr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Nov 04 01:52:42.821810 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:42.821386 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" podUID="954d94ff-3308-4877-a781-e7f71513df5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Nov 04 01:52:42.880186 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:42.879387 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:42.906991 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:42.906962 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:52:43.825808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:43.823350 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-nwszr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Nov 04 01:52:43.825808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:43.823411 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" podUID="954d94ff-3308-4877-a781-e7f71513df5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Nov 04 01:52:44.817976 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:44.817942 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-nwszr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Nov 04 01:52:44.818411 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:44.818002 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" podUID="954d94ff-3308-4877-a781-e7f71513df5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Nov 04 01:52:45.818886 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:45.818489 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-nwszr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Nov 04 01:52:45.818886 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:45.818547 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" podUID="954d94ff-3308-4877-a781-e7f71513df5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Nov 04 01:52:46.818061 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:46.818026 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-nwszr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Nov 04 01:52:46.818348 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:46.818319 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" podUID="954d94ff-3308-4877-a781-e7f71513df5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Nov 04 01:52:47.818588 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:47.818546 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-nwszr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Nov 04 01:52:47.819110 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:47.818619 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" podUID="954d94ff-3308-4877-a781-e7f71513df5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Nov 04 01:52:48.965809 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:48.963324 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:48.965809 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:48.964679 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:48.965809 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:48.965628 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-nwszr" Nov 04 01:52:50.498246 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:52:50.498202 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:52:52.197085 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.197003 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" podUID="5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" containerName="main" containerID="cri-o://71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94" gracePeriod=45 Nov 04 01:52:52.294027 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.293984 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" podUID="cf150306-6aa9-4427-ac21-eeb8c7d72762" containerName="main" containerID="cri-o://87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1" gracePeriod=45 Nov 04 01:52:52.329111 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.328798 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" podUID="5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": dial tcp 10.133.0.47:8000: connect: connection refused" Nov 04 01:52:52.553109 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.553079 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:52:52.597549 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.597523 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:52:52.696824 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.696633 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-home\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-home\") pod \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " Nov 04 01:52:52.696824 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.696770 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-model-cache\") pod \"cf150306-6aa9-4427-ac21-eeb8c7d72762\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " Nov 04 01:52:52.697050 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.696848 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-home\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-home\") pod \"cf150306-6aa9-4427-ac21-eeb8c7d72762\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " Nov 04 01:52:52.697050 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.696902 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-dshm\") pod \"cf150306-6aa9-4427-ac21-eeb8c7d72762\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " Nov 04 01:52:52.697050 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.696954 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-model-cache\") pod \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " Nov 04 01:52:52.697050 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.696983 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-dshm\") pod \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " Nov 04 01:52:52.697050 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.697031 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf150306-6aa9-4427-ac21-eeb8c7d72762-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf150306-6aa9-4427-ac21-eeb8c7d72762-tls-certs\") pod \"cf150306-6aa9-4427-ac21-eeb8c7d72762\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " Nov 04 01:52:52.697204 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.697073 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf150306-6aa9-4427-ac21-eeb8c7d72762-kube-api-access-9pzkc\" (UniqueName: \"kubernetes.io/projected/cf150306-6aa9-4427-ac21-eeb8c7d72762-kube-api-access-9pzkc\") pod \"cf150306-6aa9-4427-ac21-eeb8c7d72762\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " Nov 04 01:52:52.697204 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.697143 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-kube-api-access-6xll9\" (UniqueName: \"kubernetes.io/projected/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-kube-api-access-6xll9\") pod \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " Nov 04 01:52:52.697268 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.697211 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-tmp-dir\") pod \"cf150306-6aa9-4427-ac21-eeb8c7d72762\" (UID: \"cf150306-6aa9-4427-ac21-eeb8c7d72762\") " Nov 04 01:52:52.697268 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.697236 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tls-certs\") pod \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " Nov 04 01:52:52.697328 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.697273 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tmp-dir\") pod \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\" (UID: \"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f\") " Nov 04 01:52:52.698066 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.698037 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tmp-dir" pod "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" (UID: "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:52:52.698409 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.698259 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-home" pod "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" (UID: "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:52:52.698594 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.698570 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-model-cache" pod "cf150306-6aa9-4427-ac21-eeb8c7d72762" (UID: "cf150306-6aa9-4427-ac21-eeb8c7d72762"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:52:52.698763 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.698747 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-home" pod "cf150306-6aa9-4427-ac21-eeb8c7d72762" (UID: "cf150306-6aa9-4427-ac21-eeb8c7d72762"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:52:52.703250 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.702768 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf150306-6aa9-4427-ac21-eeb8c7d72762-kube-api-access-9pzkc" pod "cf150306-6aa9-4427-ac21-eeb8c7d72762" (UID: "cf150306-6aa9-4427-ac21-eeb8c7d72762"). InnerVolumeSpecName "kube-api-access-9pzkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:52:52.703250 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.702949 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf150306-6aa9-4427-ac21-eeb8c7d72762-tls-certs" pod "cf150306-6aa9-4427-ac21-eeb8c7d72762" (UID: "cf150306-6aa9-4427-ac21-eeb8c7d72762"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:52:52.703250 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.703156 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-dshm" pod "cf150306-6aa9-4427-ac21-eeb8c7d72762" (UID: "cf150306-6aa9-4427-ac21-eeb8c7d72762"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:52:52.703250 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.703166 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-tmp-dir" pod "cf150306-6aa9-4427-ac21-eeb8c7d72762" (UID: "cf150306-6aa9-4427-ac21-eeb8c7d72762"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:52:52.703658 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.703631 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-model-cache" pod "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" (UID: "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:52:52.703928 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.703900 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-dshm" pod "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" (UID: "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:52:52.706030 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.706002 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tls-certs" pod "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" (UID: "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:52:52.707360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.707342 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-kube-api-access-6xll9" pod "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" (UID: "5c80f6b7-1b85-4068-a246-f3e2b3be5e8f"). InnerVolumeSpecName "kube-api-access-6xll9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:52:52.798765 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798736 5537 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-dshm\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.798765 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798760 5537 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-model-cache\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.798765 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798769 5537 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-dshm\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.799122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798795 5537 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf150306-6aa9-4427-ac21-eeb8c7d72762-tls-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.799122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798804 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pzkc\" (UniqueName: \"kubernetes.io/projected/cf150306-6aa9-4427-ac21-eeb8c7d72762-kube-api-access-9pzkc\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.799122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798816 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xll9\" (UniqueName: \"kubernetes.io/projected/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-kube-api-access-6xll9\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.799122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798825 5537 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-tmp-dir\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.799122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798833 5537 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tls-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.799122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798841 5537 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-tmp-dir\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.799122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798849 5537 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f-home\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.799122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798855 5537 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-model-cache\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.799122 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.798864 5537 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf150306-6aa9-4427-ac21-eeb8c7d72762-home\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:52:52.990993 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.990956 5537 generic.go:356] "Generic (PLEG): container finished" podID="5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" containerID="71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94" exitCode=0 Nov 04 01:52:52.991216 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.991008 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" Nov 04 01:52:52.991216 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.991058 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" event={"ID":"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f","Type":"ContainerDied","Data":"71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94"} Nov 04 01:52:52.991216 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.991118 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn" event={"ID":"5c80f6b7-1b85-4068-a246-f3e2b3be5e8f","Type":"ContainerDied","Data":"03f60520e63bac1111e955df15f759710d901c4639da3588d0a60efc41d5deb6"} Nov 04 01:52:52.991216 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.991142 5537 scope.go:122] "RemoveContainer" containerID="71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94" Nov 04 01:52:52.994870 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.994841 5537 generic.go:356] "Generic (PLEG): container finished" podID="cf150306-6aa9-4427-ac21-eeb8c7d72762" containerID="87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1" exitCode=0 Nov 04 01:52:52.995070 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.994896 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" Nov 04 01:52:52.995070 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.995005 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" event={"ID":"cf150306-6aa9-4427-ac21-eeb8c7d72762","Type":"ContainerDied","Data":"87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1"} Nov 04 01:52:52.995070 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:52.995038 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s" event={"ID":"cf150306-6aa9-4427-ac21-eeb8c7d72762","Type":"ContainerDied","Data":"ca35653115ca7a0b249a274843b374a818ec5ba8a58f59479af4f048b95c6547"} Nov 04 01:52:53.003834 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:53.003819 5537 scope.go:122] "RemoveContainer" containerID="71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94" Nov 04 01:52:53.004082 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:52:53.004063 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94\": container with ID starting with 71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94 not found: ID does not exist" containerID="71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94" Nov 04 01:52:53.004154 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:53.004094 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94"} err="failed to get container status \"71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94\": rpc error: code = NotFound desc = could not find container \"71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94\": container with ID starting with 71af75013ad3e7ff8f841358def11ec8b379d366a1a47fbed35cd5a53dd51a94 not found: ID does not exist" Nov 04 01:52:53.004154 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:53.004118 5537 scope.go:122] "RemoveContainer" containerID="87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1" Nov 04 01:52:53.012356 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:53.012337 5537 scope.go:122] "RemoveContainer" containerID="87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1" Nov 04 01:52:53.012610 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:52:53.012592 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1\": container with ID starting with 87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1 not found: ID does not exist" containerID="87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1" Nov 04 01:52:53.012672 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:53.012622 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1"} err="failed to get container status \"87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1\": rpc error: code = NotFound desc = could not find container \"87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1\": container with ID starting with 87cc4920a9822fd4e68009780b04a79fdd341d650b496aeb1de6b0252ba6d2f1 not found: ID does not exist" Nov 04 01:52:53.156423 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:53.156345 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s"] Nov 04 01:52:53.160407 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:53.160371 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-w4-f4d202-kserve-775b686f87-f4t2s"] Nov 04 01:52:53.280919 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:53.280883 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn"] Nov 04 01:52:53.282361 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:53.282335 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f4d202/distinct-2-w4-f4d202-kserve-df58d9f6-xfppn"] Nov 04 01:52:54.643380 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:54.643350 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" path="/var/lib/kubelet/pods/5c80f6b7-1b85-4068-a246-f3e2b3be5e8f/volumes" Nov 04 01:52:54.643934 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:52:54.643916 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf150306-6aa9-4427-ac21-eeb8c7d72762" path="/var/lib/kubelet/pods/cf150306-6aa9-4427-ac21-eeb8c7d72762/volumes" Nov 04 01:53:04.394204 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.394164 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g"] Nov 04 01:53:04.394837 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.394816 5537 cpu_manager.go:414] "containerMap: removing container" podUID="cf150306-6aa9-4427-ac21-eeb8c7d72762" containerName="main" Nov 04 01:53:04.394947 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.394839 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf150306-6aa9-4427-ac21-eeb8c7d72762" containerName="main" Nov 04 01:53:04.394947 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.394868 5537 cpu_manager.go:414] "containerMap: removing container" podUID="5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" containerName="main" Nov 04 01:53:04.394947 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.394873 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" containerName="main" Nov 04 01:53:04.395123 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.394975 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c80f6b7-1b85-4068-a246-f3e2b3be5e8f" containerName="main" Nov 04 01:53:04.395123 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.394989 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf150306-6aa9-4427-ac21-eeb8c7d72762" containerName="main" Nov 04 01:53:04.398372 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.398356 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.455659 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.455627 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g"] Nov 04 01:53:04.501837 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.501773 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-c0ab5f-serving-cert\"" Nov 04 01:53:04.553224 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.553187 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-maas-api-tls\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.553224 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.553230 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-metrics-certs\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.553471 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.553339 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfqgn\" (UniqueName: \"kubernetes.io/projected/b37e6df0-1c12-4a96-aa60-826a92462955-kube-api-access-hfqgn\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.553471 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.553455 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37e6df0-1c12-4a96-aa60-826a92462955-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.673858 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.658592 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37e6df0-1c12-4a96-aa60-826a92462955-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.673858 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.658834 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-maas-api-tls\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.673858 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.658885 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-metrics-certs\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.673858 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.658967 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfqgn\" (UniqueName: \"kubernetes.io/projected/b37e6df0-1c12-4a96-aa60-826a92462955-kube-api-access-hfqgn\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.673858 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:53:04.660941 5537 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-serving-cert: secret "maas-api-e2e-extmod-b-c0ab5f-serving-cert" not found Nov 04 01:53:04.673858 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:53:04.661080 5537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-maas-api-tls podName:b37e6df0-1c12-4a96-aa60-826a92462955 nodeName:}" failed. No retries permitted until 2026-11-04 01:53:05.161058015 +0000 UTC m=+1074.633652309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-maas-api-tls") pod "maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" (UID: "b37e6df0-1c12-4a96-aa60-826a92462955") : secret "maas-api-e2e-extmod-b-c0ab5f-serving-cert" not found Nov 04 01:53:04.678030 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.677956 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37e6df0-1c12-4a96-aa60-826a92462955-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.685524 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.685492 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-metrics-certs\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:04.732614 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:04.732582 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfqgn\" (UniqueName: \"kubernetes.io/projected/b37e6df0-1c12-4a96-aa60-826a92462955-kube-api-access-hfqgn\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:05.168295 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:05.168258 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-maas-api-tls\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:05.170873 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:05.170849 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-maas-api-tls\") pod \"maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:05.310705 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:05.310669 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:05.686236 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:05.686214 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g"] Nov 04 01:53:05.691695 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:53:05.691664 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37e6df0_1c12_4a96_aa60_826a92462955.slice/crio-846ef6e6857d10e3790e784ad2b60eeb9a8ac1733ef8e919f1a05bab67be6b98 WatchSource:0}: Error finding container 846ef6e6857d10e3790e784ad2b60eeb9a8ac1733ef8e919f1a05bab67be6b98: Status 404 returned error can't find the container with id 846ef6e6857d10e3790e784ad2b60eeb9a8ac1733ef8e919f1a05bab67be6b98 Nov 04 01:53:05.693532 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:05.693511 5537 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 01:53:06.094492 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:06.094454 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" event={"ID":"b37e6df0-1c12-4a96-aa60-826a92462955","Type":"ContainerStarted","Data":"846ef6e6857d10e3790e784ad2b60eeb9a8ac1733ef8e919f1a05bab67be6b98"} Nov 04 01:53:07.101556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:07.101524 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" event={"ID":"b37e6df0-1c12-4a96-aa60-826a92462955","Type":"ContainerStarted","Data":"fe94d8526245f825a3b2df8b5dbc5ae92f656792fd38640cdc9e0e518f0e28d0"} Nov 04 01:53:07.101968 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:07.101636 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:07.220167 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:07.220115 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" podStartSLOduration=2.271064904 podStartE2EDuration="3.220100366s" totalImagesPullingTime="949.035462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:53:07.21861707 +0000 UTC m=+1076.691211364" watchObservedRunningTime="2026-11-04 01:53:07.220100366 +0000 UTC m=+1076.692694657" Nov 04 01:53:13.112991 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:13.112961 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:53:20.493941 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:53:20.493856 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:53:23.289910 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.289870 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb"] Nov 04 01:53:23.290461 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.290065 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" podUID="aa529724-afc1-4dcc-9dcb-6e40e20d4b62" containerName="maas-api" containerID="cri-o://4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72" gracePeriod=30 Nov 04 01:53:23.783355 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.783009 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:53:23.852912 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.837947 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-metrics-certs\") pod \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " Nov 04 01:53:23.852912 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.838005 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-openshift-service-ca\") pod \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " Nov 04 01:53:23.852912 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.838068 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-maas-api-tls\") pod \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " Nov 04 01:53:23.852912 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.838240 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-kube-api-access-xt4g6\" (UniqueName: \"kubernetes.io/projected/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-kube-api-access-xt4g6\") pod \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\" (UID: \"aa529724-afc1-4dcc-9dcb-6e40e20d4b62\") " Nov 04 01:53:23.872373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.872049 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-openshift-service-ca" pod "aa529724-afc1-4dcc-9dcb-6e40e20d4b62" (UID: "aa529724-afc1-4dcc-9dcb-6e40e20d4b62"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:53:23.906137 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.878978 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-maas-api-tls" pod "aa529724-afc1-4dcc-9dcb-6e40e20d4b62" (UID: "aa529724-afc1-4dcc-9dcb-6e40e20d4b62"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:53:23.926272 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.917966 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-metrics-certs" pod "aa529724-afc1-4dcc-9dcb-6e40e20d4b62" (UID: "aa529724-afc1-4dcc-9dcb-6e40e20d4b62"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:53:23.977825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.941809 5537 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-maas-api-tls\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:23.977825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.941851 5537 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-metrics-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:23.977825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.941868 5537 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-openshift-service-ca\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:23.977825 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:23.952356 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-kube-api-access-xt4g6" pod "aa529724-afc1-4dcc-9dcb-6e40e20d4b62" (UID: "aa529724-afc1-4dcc-9dcb-6e40e20d4b62"). InnerVolumeSpecName "kube-api-access-xt4g6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:53:24.042941 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.042904 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt4g6\" (UniqueName: \"kubernetes.io/projected/aa529724-afc1-4dcc-9dcb-6e40e20d4b62-kube-api-access-xt4g6\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:24.276806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.275971 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" event={"ID":"aa529724-afc1-4dcc-9dcb-6e40e20d4b62","Type":"ContainerDied","Data":"4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72"} Nov 04 01:53:24.276806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.276078 5537 scope.go:122] "RemoveContainer" containerID="4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72" Nov 04 01:53:24.276806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.276234 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" Nov 04 01:53:24.277114 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.275857 5537 generic.go:356] "Generic (PLEG): container finished" podID="aa529724-afc1-4dcc-9dcb-6e40e20d4b62" containerID="4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72" exitCode=0 Nov 04 01:53:24.280805 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.277391 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb" event={"ID":"aa529724-afc1-4dcc-9dcb-6e40e20d4b62","Type":"ContainerDied","Data":"2c2c7f30cdc16b2035ed7ab70601ef7793d07f947b30552d76f2c78551738c1e"} Nov 04 01:53:24.363345 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.355043 5537 scope.go:122] "RemoveContainer" containerID="4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72" Nov 04 01:53:24.363345 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:53:24.355578 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72\": container with ID starting with 4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72 not found: ID does not exist" containerID="4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72" Nov 04 01:53:24.363345 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.355629 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72"} err="failed to get container status \"4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72\": rpc error: code = NotFound desc = could not find container \"4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72\": container with ID starting with 4ef2bcc3fac0fe2d21d386988639906e96af5cb8e50c24598e937407172f2c72 not found: ID does not exist" Nov 04 01:53:24.445016 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.444984 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb"] Nov 04 01:53:24.494348 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.494308 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-f4d202-7f85b6b888-rzhrb"] Nov 04 01:53:24.643760 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:24.643684 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa529724-afc1-4dcc-9dcb-6e40e20d4b62" path="/var/lib/kubelet/pods/aa529724-afc1-4dcc-9dcb-6e40e20d4b62/volumes" Nov 04 01:53:28.086906 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:28.086868 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4"] Nov 04 01:53:28.087390 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:28.087083 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerName="istio-proxy" containerID="cri-o://643d18d9d951b9a66946063d52e0c6173643219976a230dad4f430c4d94232fe" gracePeriod=30 Nov 04 01:53:29.998431 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:29.998392 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f"] Nov 04 01:53:29.999244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:29.999224 5537 cpu_manager.go:414] "containerMap: removing container" podUID="aa529724-afc1-4dcc-9dcb-6e40e20d4b62" containerName="maas-api" Nov 04 01:53:29.999298 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:29.999249 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa529724-afc1-4dcc-9dcb-6e40e20d4b62" containerName="maas-api" Nov 04 01:53:29.999415 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:29.999403 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa529724-afc1-4dcc-9dcb-6e40e20d4b62" containerName="maas-api" Nov 04 01:53:30.003342 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.003323 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.048105 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.048071 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-maas-api-tls\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.048311 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.048247 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9896732-3c47-4d0a-80d8-6e02c134dd18-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.048311 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.048287 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd2v2\" (UniqueName: \"kubernetes.io/projected/a9896732-3c47-4d0a-80d8-6e02c134dd18-kube-api-access-qd2v2\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.048435 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.048405 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-metrics-certs\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.059013 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.058978 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f"] Nov 04 01:53:30.104903 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.104869 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-a-79badd-serving-cert\"" Nov 04 01:53:30.150050 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.150007 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-metrics-certs\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.150266 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.150093 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-maas-api-tls\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.150266 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:53:30.150221 5537 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-serving-cert: secret "maas-api-e2e-extmod-a-79badd-serving-cert" not found Nov 04 01:53:30.150266 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.150244 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9896732-3c47-4d0a-80d8-6e02c134dd18-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.150417 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:53:30.150287 5537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-maas-api-tls podName:a9896732-3c47-4d0a-80d8-6e02c134dd18 nodeName:}" failed. No retries permitted until 2026-11-04 01:53:30.650264477 +0000 UTC m=+1100.122858751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-maas-api-tls") pod "maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" (UID: "a9896732-3c47-4d0a-80d8-6e02c134dd18") : secret "maas-api-e2e-extmod-a-79badd-serving-cert" not found Nov 04 01:53:30.150417 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.150330 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd2v2\" (UniqueName: \"kubernetes.io/projected/a9896732-3c47-4d0a-80d8-6e02c134dd18-kube-api-access-qd2v2\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.151089 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.151064 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9896732-3c47-4d0a-80d8-6e02c134dd18-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.152664 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.152643 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-metrics-certs\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.211593 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.211565 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd2v2\" (UniqueName: \"kubernetes.io/projected/a9896732-3c47-4d0a-80d8-6e02c134dd18-kube-api-access-qd2v2\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.656742 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.656699 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-maas-api-tls\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.659662 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.659626 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-maas-api-tls\") pod \"maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:30.917826 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:30.917720 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:31.301192 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:31.301168 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f"] Nov 04 01:53:31.303303 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:53:31.303275 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9896732_3c47_4d0a_80d8_6e02c134dd18.slice/crio-5532b2403c726e14bfa45150f0d63f450e630843b8b8bc4c8b3f65e4ac888568 WatchSource:0}: Error finding container 5532b2403c726e14bfa45150f0d63f450e630843b8b8bc4c8b3f65e4ac888568: Status 404 returned error can't find the container with id 5532b2403c726e14bfa45150f0d63f450e630843b8b8bc4c8b3f65e4ac888568 Nov 04 01:53:31.344817 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:31.344757 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" event={"ID":"a9896732-3c47-4d0a-80d8-6e02c134dd18","Type":"ContainerStarted","Data":"5532b2403c726e14bfa45150f0d63f450e630843b8b8bc4c8b3f65e4ac888568"} Nov 04 01:53:31.943231 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:31.943189 5537 patch_prober.go:29] interesting pod/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 01:53:31.943401 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:31.943263 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 01:53:33.359652 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.359567 5537 generic.go:356] "Generic (PLEG): container finished" podID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerID="643d18d9d951b9a66946063d52e0c6173643219976a230dad4f430c4d94232fe" exitCode=0 Nov 04 01:53:33.360127 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.359644 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" event={"ID":"9b6007de-bff5-4127-8cc9-5d0e9301ac4b","Type":"ContainerDied","Data":"643d18d9d951b9a66946063d52e0c6173643219976a230dad4f430c4d94232fe"} Nov 04 01:53:33.361556 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.361528 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" event={"ID":"a9896732-3c47-4d0a-80d8-6e02c134dd18","Type":"ContainerStarted","Data":"b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d"} Nov 04 01:53:33.361698 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.361587 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:33.363344 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.363322 5537 generic.go:356] "Generic (PLEG): container finished" podID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerID="c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755" exitCode=0 Nov 04 01:53:33.363464 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.363363 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" event={"ID":"522a1ef4-7857-445b-94e0-bfa71bdf42e8","Type":"ContainerDied","Data":"c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755"} Nov 04 01:53:33.363692 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.363678 5537 scope.go:122] "RemoveContainer" containerID="c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755" Nov 04 01:53:33.365144 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.365115 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:53:33.365271 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.365197 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:53:33.365271 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.365245 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:53:33.419871 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.419849 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:53:33.481404 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.481350 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" podStartSLOduration=3.49161939 podStartE2EDuration="4.481332872s" totalImagesPullingTime="989.713482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:53:33.478890483 +0000 UTC m=+1102.951484775" watchObservedRunningTime="2026-11-04 01:53:33.481332872 +0000 UTC m=+1102.953927164" Nov 04 01:53:33.518280 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518247 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-token\" (UniqueName: \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-token\") pod \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " Nov 04 01:53:33.518470 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518301 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-credential-socket\") pod \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " Nov 04 01:53:33.518470 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518322 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istiod-ca-cert\") pod \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " Nov 04 01:53:33.518470 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518338 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-socket\") pod \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " Nov 04 01:53:33.518470 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518385 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-podinfo\") pod \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " Nov 04 01:53:33.518682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518513 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-certs\") pod \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " Nov 04 01:53:33.518682 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518628 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-data\") pod \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " Nov 04 01:53:33.518806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518655 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-credential-socket" pod "9b6007de-bff5-4127-8cc9-5d0e9301ac4b" (UID: "9b6007de-bff5-4127-8cc9-5d0e9301ac4b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:53:33.518806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518701 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-kube-api-access-794sv\" (UniqueName: \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-kube-api-access-794sv\") pod \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " Nov 04 01:53:33.518806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518702 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-socket" pod "9b6007de-bff5-4127-8cc9-5d0e9301ac4b" (UID: "9b6007de-bff5-4127-8cc9-5d0e9301ac4b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:53:33.518806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518728 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-envoy\") pod \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\" (UID: \"9b6007de-bff5-4127-8cc9-5d0e9301ac4b\") " Nov 04 01:53:33.518806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518733 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istiod-ca-cert" pod "9b6007de-bff5-4127-8cc9-5d0e9301ac4b" (UID: "9b6007de-bff5-4127-8cc9-5d0e9301ac4b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:53:33.519078 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518902 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-data" pod "9b6007de-bff5-4127-8cc9-5d0e9301ac4b" (UID: "9b6007de-bff5-4127-8cc9-5d0e9301ac4b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:53:33.519078 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.518926 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-certs" pod "9b6007de-bff5-4127-8cc9-5d0e9301ac4b" (UID: "9b6007de-bff5-4127-8cc9-5d0e9301ac4b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:53:33.519311 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.519288 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:33.519397 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.519318 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:33.519397 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.519333 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:33.519397 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.519350 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:33.519397 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.519363 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:33.521381 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.521186 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-envoy" pod "9b6007de-bff5-4127-8cc9-5d0e9301ac4b" (UID: "9b6007de-bff5-4127-8cc9-5d0e9301ac4b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:53:33.521381 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.521246 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-kube-api-access-794sv" pod "9b6007de-bff5-4127-8cc9-5d0e9301ac4b" (UID: "9b6007de-bff5-4127-8cc9-5d0e9301ac4b"). InnerVolumeSpecName "kube-api-access-794sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:53:33.521381 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.521349 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-token" pod "9b6007de-bff5-4127-8cc9-5d0e9301ac4b" (UID: "9b6007de-bff5-4127-8cc9-5d0e9301ac4b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:53:33.521381 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.521366 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-podinfo" pod "9b6007de-bff5-4127-8cc9-5d0e9301ac4b" (UID: "9b6007de-bff5-4127-8cc9-5d0e9301ac4b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:53:33.620530 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.620440 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:33.620530 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.620467 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:33.620530 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.620477 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-794sv\" (UniqueName: \"kubernetes.io/projected/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-kube-api-access-794sv\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:33.620530 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.620486 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6007de-bff5-4127-8cc9-5d0e9301ac4b-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:53:33.695249 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:33.695136 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:53:34.393155 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:34.393109 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" event={"ID":"522a1ef4-7857-445b-94e0-bfa71bdf42e8","Type":"ContainerStarted","Data":"b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd"} Nov 04 01:53:34.394601 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:34.394567 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" Nov 04 01:53:34.394750 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:34.394597 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4" event={"ID":"9b6007de-bff5-4127-8cc9-5d0e9301ac4b","Type":"ContainerDied","Data":"44e46fc21772306f055e3f60c950d83f91d71d3da134ca3bce6853bfa5ee4389"} Nov 04 01:53:34.394750 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:34.394651 5537 scope.go:122] "RemoveContainer" containerID="643d18d9d951b9a66946063d52e0c6173643219976a230dad4f430c4d94232fe" Nov 04 01:53:34.692584 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:34.692499 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4"] Nov 04 01:53:34.704922 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:34.704886 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-f4d202-openshift-default-6f686cbcdf-gs7w4"] Nov 04 01:53:34.848737 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:34.848700 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:53:34.849967 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:34.849938 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 04 01:53:34.850075 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:34.849999 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 04 01:53:35.849145 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:35.849111 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 04 01:53:35.849573 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:35.849174 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 04 01:53:36.643368 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:36.643327 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" path="/var/lib/kubelet/pods/9b6007de-bff5-4127-8cc9-5d0e9301ac4b/volumes" Nov 04 01:53:36.849373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:36.849340 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 04 01:53:36.849807 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:36.849389 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 04 01:53:37.849030 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:37.848993 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 04 01:53:37.849240 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:37.849052 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 04 01:53:38.848908 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:38.848877 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Nov 04 01:53:38.849322 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:38.848934 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Nov 04 01:53:39.400954 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:39.400925 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:53:39.853093 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:39.853059 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:53:39.853586 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:39.853449 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:53:39.854222 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:39.854205 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:53:48.737975 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:48.737935 5537 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-kh4xr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 01:53:48.738515 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:48.738015 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-kh4xr" podUID="ecee57db-4ef6-4215-9447-c457d2018691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 01:53:50.492994 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:53:50.492957 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:53:54.655317 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:54.655275 5537 generic.go:356] "Generic (PLEG): container finished" podID="89a932f5-c594-4ca1-9f76-6551146d4209" containerID="4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e" exitCode=0 Nov 04 01:53:54.656147 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:54.656116 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" event={"ID":"89a932f5-c594-4ca1-9f76-6551146d4209","Type":"ContainerDied","Data":"4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e"} Nov 04 01:53:54.656547 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:54.656530 5537 scope.go:122] "RemoveContainer" containerID="4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e" Nov 04 01:53:54.658076 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:54.658045 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:53:54.658175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:54.658133 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:53:54.658239 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:54.658187 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:53:55.664121 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:55.664082 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" event={"ID":"89a932f5-c594-4ca1-9f76-6551146d4209","Type":"ContainerStarted","Data":"3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989"} Nov 04 01:53:56.122870 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:56.122840 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:53:56.124179 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:56.124144 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Nov 04 01:53:56.124324 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:56.124205 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Nov 04 01:53:57.123670 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:57.123637 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Nov 04 01:53:57.124096 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:57.123688 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Nov 04 01:53:57.869895 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:57.869864 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:53:58.122850 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:58.122749 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Nov 04 01:53:58.122850 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:58.122831 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Nov 04 01:53:59.123761 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:59.123726 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Nov 04 01:53:59.124197 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:53:59.123804 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Nov 04 01:54:00.123066 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:00.123032 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Nov 04 01:54:00.123252 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:00.123084 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Nov 04 01:54:01.128123 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:01.128092 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:54:01.129223 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:01.129205 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:54:20.493981 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:54:20.493941 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:54:35.913493 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:35.913459 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm"] Nov 04 01:54:35.913960 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:35.913699 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" containerID="cri-o://9132713a4b2bce2c6df93b6d382f91de7bf859fae16400a9967fd7e52766f543" gracePeriod=30 Nov 04 01:54:41.073436 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.073404 5537 generic.go:356] "Generic (PLEG): container finished" podID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerID="9132713a4b2bce2c6df93b6d382f91de7bf859fae16400a9967fd7e52766f543" exitCode=0 Nov 04 01:54:41.073854 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.073473 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" event={"ID":"3b10fb3d-1f1c-401c-8fdb-78111c45fb94","Type":"ContainerDied","Data":"9132713a4b2bce2c6df93b6d382f91de7bf859fae16400a9967fd7e52766f543"} Nov 04 01:54:41.073854 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.073537 5537 scope.go:122] "RemoveContainer" containerID="757520d2df295678638d5fdc08de49b16004c75dae200f8228f3d053d7a64d06" Nov 04 01:54:41.182665 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.182601 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:54:41.301405 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.301374 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-kube-api-access-ssvgs\" (UniqueName: \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-kube-api-access-ssvgs\") pod \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " Nov 04 01:54:41.301590 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.301431 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-envoy\") pod \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " Nov 04 01:54:41.301590 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.301513 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-data\") pod \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " Nov 04 01:54:41.301590 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.301569 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-podinfo\") pod \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " Nov 04 01:54:41.301717 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.301665 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istiod-ca-cert\") pod \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " Nov 04 01:54:41.301717 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.301709 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-certs\") pod \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " Nov 04 01:54:41.301873 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.301747 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-socket\") pod \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " Nov 04 01:54:41.301873 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.301815 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-credential-socket\") pod \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " Nov 04 01:54:41.301981 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.301866 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-data" pod "3b10fb3d-1f1c-401c-8fdb-78111c45fb94" (UID: "3b10fb3d-1f1c-401c-8fdb-78111c45fb94"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:54:41.301981 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.301915 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-token\" (UniqueName: \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-token\") pod \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\" (UID: \"3b10fb3d-1f1c-401c-8fdb-78111c45fb94\") " Nov 04 01:54:41.302488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.302141 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-credential-socket" pod "3b10fb3d-1f1c-401c-8fdb-78111c45fb94" (UID: "3b10fb3d-1f1c-401c-8fdb-78111c45fb94"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:54:41.302488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.302160 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-socket" pod "3b10fb3d-1f1c-401c-8fdb-78111c45fb94" (UID: "3b10fb3d-1f1c-401c-8fdb-78111c45fb94"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:54:41.302488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.302181 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istiod-ca-cert" pod "3b10fb3d-1f1c-401c-8fdb-78111c45fb94" (UID: "3b10fb3d-1f1c-401c-8fdb-78111c45fb94"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:54:41.302488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.302184 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-certs" pod "3b10fb3d-1f1c-401c-8fdb-78111c45fb94" (UID: "3b10fb3d-1f1c-401c-8fdb-78111c45fb94"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:54:41.302488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.302422 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:54:41.302488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.302442 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:54:41.302488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.302452 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:54:41.302488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.302461 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:54:41.302488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.302470 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:54:41.303992 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.303963 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-envoy" pod "3b10fb3d-1f1c-401c-8fdb-78111c45fb94" (UID: "3b10fb3d-1f1c-401c-8fdb-78111c45fb94"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:54:41.303992 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.303981 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-kube-api-access-ssvgs" pod "3b10fb3d-1f1c-401c-8fdb-78111c45fb94" (UID: "3b10fb3d-1f1c-401c-8fdb-78111c45fb94"). InnerVolumeSpecName "kube-api-access-ssvgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:54:41.304177 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.304055 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-podinfo" pod "3b10fb3d-1f1c-401c-8fdb-78111c45fb94" (UID: "3b10fb3d-1f1c-401c-8fdb-78111c45fb94"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:54:41.304392 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.304374 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-token" pod "3b10fb3d-1f1c-401c-8fdb-78111c45fb94" (UID: "3b10fb3d-1f1c-401c-8fdb-78111c45fb94"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:54:41.403421 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.403388 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:54:41.403421 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.403417 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:54:41.403421 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.403428 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssvgs\" (UniqueName: \"kubernetes.io/projected/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-kube-api-access-ssvgs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:54:41.403657 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:41.403437 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b10fb3d-1f1c-401c-8fdb-78111c45fb94-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:54:42.080540 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:42.080511 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" Nov 04 01:54:42.081067 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:42.080537 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm" event={"ID":"3b10fb3d-1f1c-401c-8fdb-78111c45fb94","Type":"ContainerDied","Data":"bc57bac4e96f2fbbaf2268fe583255bbb2641b73a60732fe6a77f286750c1643"} Nov 04 01:54:42.081067 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:42.080597 5537 scope.go:122] "RemoveContainer" containerID="9132713a4b2bce2c6df93b6d382f91de7bf859fae16400a9967fd7e52766f543" Nov 04 01:54:42.244468 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:42.244426 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm"] Nov 04 01:54:42.293953 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:42.293920 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-c62113-openshift-default-76976bdfd9-vs5jm"] Nov 04 01:54:42.644012 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:42.643982 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" path="/var/lib/kubelet/pods/3b10fb3d-1f1c-401c-8fdb-78111c45fb94/volumes" Nov 04 01:54:50.493271 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:54:50.493187 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:54:57.245841 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:57.245807 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w"] Nov 04 01:54:57.246327 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:54:57.246085 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" containerID="cri-o://6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92" gracePeriod=30 Nov 04 01:55:02.519120 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.519049 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:55:02.633131 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633096 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-kube-api-access-k6zpd\" (UniqueName: \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-kube-api-access-k6zpd\") pod \"07aaebde-805e-4089-bca0-a58bd396fe97\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " Nov 04 01:55:02.633335 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633181 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-envoy\") pod \"07aaebde-805e-4089-bca0-a58bd396fe97\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " Nov 04 01:55:02.633335 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633237 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/07aaebde-805e-4089-bca0-a58bd396fe97-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07aaebde-805e-4089-bca0-a58bd396fe97-istio-podinfo\") pod \"07aaebde-805e-4089-bca0-a58bd396fe97\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " Nov 04 01:55:02.633335 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633308 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07aaebde-805e-4089-bca0-a58bd396fe97-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07aaebde-805e-4089-bca0-a58bd396fe97-istiod-ca-cert\") pod \"07aaebde-805e-4089-bca0-a58bd396fe97\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " Nov 04 01:55:02.633500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633370 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-istio-token\" (UniqueName: \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-istio-token\") pod \"07aaebde-805e-4089-bca0-a58bd396fe97\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " Nov 04 01:55:02.633500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633386 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-socket\") pod \"07aaebde-805e-4089-bca0-a58bd396fe97\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " Nov 04 01:55:02.633500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633408 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-data\") pod \"07aaebde-805e-4089-bca0-a58bd396fe97\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " Nov 04 01:55:02.633500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633426 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-certs\") pod \"07aaebde-805e-4089-bca0-a58bd396fe97\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " Nov 04 01:55:02.633500 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633465 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-credential-socket\") pod \"07aaebde-805e-4089-bca0-a58bd396fe97\" (UID: \"07aaebde-805e-4089-bca0-a58bd396fe97\") " Nov 04 01:55:02.633744 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633707 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-socket" pod "07aaebde-805e-4089-bca0-a58bd396fe97" (UID: "07aaebde-805e-4089-bca0-a58bd396fe97"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:55:02.633851 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633825 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07aaebde-805e-4089-bca0-a58bd396fe97-istiod-ca-cert" pod "07aaebde-805e-4089-bca0-a58bd396fe97" (UID: "07aaebde-805e-4089-bca0-a58bd396fe97"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:55:02.634028 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633959 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-data" pod "07aaebde-805e-4089-bca0-a58bd396fe97" (UID: "07aaebde-805e-4089-bca0-a58bd396fe97"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:55:02.634028 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.633997 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07aaebde-805e-4089-bca0-a58bd396fe97-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:02.634028 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.634021 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:02.634028 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.634001 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-credential-socket" pod "07aaebde-805e-4089-bca0-a58bd396fe97" (UID: "07aaebde-805e-4089-bca0-a58bd396fe97"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:55:02.634343 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.634293 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-certs" pod "07aaebde-805e-4089-bca0-a58bd396fe97" (UID: "07aaebde-805e-4089-bca0-a58bd396fe97"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:55:02.635757 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.635728 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-envoy" pod "07aaebde-805e-4089-bca0-a58bd396fe97" (UID: "07aaebde-805e-4089-bca0-a58bd396fe97"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:55:02.635757 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.635734 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-kube-api-access-k6zpd" pod "07aaebde-805e-4089-bca0-a58bd396fe97" (UID: "07aaebde-805e-4089-bca0-a58bd396fe97"). InnerVolumeSpecName "kube-api-access-k6zpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:55:02.636261 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.636235 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-istio-token" pod "07aaebde-805e-4089-bca0-a58bd396fe97" (UID: "07aaebde-805e-4089-bca0-a58bd396fe97"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:55:02.636261 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.636240 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07aaebde-805e-4089-bca0-a58bd396fe97-istio-podinfo" pod "07aaebde-805e-4089-bca0-a58bd396fe97" (UID: "07aaebde-805e-4089-bca0-a58bd396fe97"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:55:02.734807 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.734741 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6zpd\" (UniqueName: \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-kube-api-access-k6zpd\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:02.734807 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.734775 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:02.735023 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.734820 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07aaebde-805e-4089-bca0-a58bd396fe97-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:02.735023 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.734834 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aaebde-805e-4089-bca0-a58bd396fe97-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:02.735023 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.734848 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:02.735023 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.734865 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:02.735023 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.734881 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aaebde-805e-4089-bca0-a58bd396fe97-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:02.746642 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:02.746615 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff"] Nov 04 01:55:03.215806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.215750 5537 generic.go:356] "Generic (PLEG): container finished" podID="07aaebde-805e-4089-bca0-a58bd396fe97" containerID="6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92" exitCode=0 Nov 04 01:55:03.216078 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.215822 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" event={"ID":"07aaebde-805e-4089-bca0-a58bd396fe97","Type":"ContainerDied","Data":"6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92"} Nov 04 01:55:03.216078 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.215867 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" Nov 04 01:55:03.216078 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.215922 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w" event={"ID":"07aaebde-805e-4089-bca0-a58bd396fe97","Type":"ContainerDied","Data":"2a949c16785be45672a0f97910706260f4b1e19b7b5338d635143183503c9fc7"} Nov 04 01:55:03.216078 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.215952 5537 scope.go:122] "RemoveContainer" containerID="6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92" Nov 04 01:55:03.225523 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.225505 5537 scope.go:122] "RemoveContainer" containerID="78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e" Nov 04 01:55:03.234187 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.234170 5537 scope.go:122] "RemoveContainer" containerID="6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92" Nov 04 01:55:03.234442 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:55:03.234423 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92\": container with ID starting with 6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92 not found: ID does not exist" containerID="6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92" Nov 04 01:55:03.234488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.234450 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92"} err="failed to get container status \"6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92\": rpc error: code = NotFound desc = could not find container \"6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92\": container with ID starting with 6008d1b8ca1079e5df7cf78a71273a2c58c3f34eb92b0fa63227008ba4e58f92 not found: ID does not exist" Nov 04 01:55:03.234488 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.234467 5537 scope.go:122] "RemoveContainer" containerID="78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e" Nov 04 01:55:03.234671 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:55:03.234655 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e\": container with ID starting with 78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e not found: ID does not exist" containerID="78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e" Nov 04 01:55:03.234715 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.234676 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e"} err="failed to get container status \"78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e\": rpc error: code = NotFound desc = could not find container \"78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e\": container with ID starting with 78ede53c56ca2a53b16f9cf9f5057be196a9dc326bc13c06ded42056c4d8cc9e not found: ID does not exist" Nov 04 01:55:03.380448 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.380415 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w"] Nov 04 01:55:03.430005 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:03.429975 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-c2cde5-openshift-default-76cd4cdf5c-hdl6w"] Nov 04 01:55:04.644058 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:04.644025 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" path="/var/lib/kubelet/pods/07aaebde-805e-4089-bca0-a58bd396fe97/volumes" Nov 04 01:55:17.767362 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:17.767303 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" podUID="e59ed2e1-2c01-4b16-885a-b3535673a642" containerName="main" containerID="cri-o://7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f" gracePeriod=45 Nov 04 01:55:17.929418 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:17.929374 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" podUID="e59ed2e1-2c01-4b16-885a-b3535673a642" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/ready\": dial tcp 10.133.0.39:8000: connect: connection refused" Nov 04 01:55:18.029725 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.029657 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:55:18.093908 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.093877 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-tmp-dir\") pod \"e59ed2e1-2c01-4b16-885a-b3535673a642\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " Nov 04 01:55:18.094076 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.093981 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e59ed2e1-2c01-4b16-885a-b3535673a642-kube-api-access-bq927\" (UniqueName: \"kubernetes.io/projected/e59ed2e1-2c01-4b16-885a-b3535673a642-kube-api-access-bq927\") pod \"e59ed2e1-2c01-4b16-885a-b3535673a642\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " Nov 04 01:55:18.094076 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.094011 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-model-cache\") pod \"e59ed2e1-2c01-4b16-885a-b3535673a642\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " Nov 04 01:55:18.094076 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.094056 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-home\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-home\") pod \"e59ed2e1-2c01-4b16-885a-b3535673a642\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " Nov 04 01:55:18.094229 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.094086 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e59ed2e1-2c01-4b16-885a-b3535673a642-tls-certs\" (UniqueName: \"kubernetes.io/secret/e59ed2e1-2c01-4b16-885a-b3535673a642-tls-certs\") pod \"e59ed2e1-2c01-4b16-885a-b3535673a642\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " Nov 04 01:55:18.094229 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.094124 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-dshm\") pod \"e59ed2e1-2c01-4b16-885a-b3535673a642\" (UID: \"e59ed2e1-2c01-4b16-885a-b3535673a642\") " Nov 04 01:55:18.094229 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.094140 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-tmp-dir" pod "e59ed2e1-2c01-4b16-885a-b3535673a642" (UID: "e59ed2e1-2c01-4b16-885a-b3535673a642"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:55:18.094383 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.094298 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-model-cache" pod "e59ed2e1-2c01-4b16-885a-b3535673a642" (UID: "e59ed2e1-2c01-4b16-885a-b3535673a642"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:55:18.094383 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.094366 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-home" pod "e59ed2e1-2c01-4b16-885a-b3535673a642" (UID: "e59ed2e1-2c01-4b16-885a-b3535673a642"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:55:18.094930 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.094894 5537 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-tmp-dir\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:18.095070 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.094935 5537 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-model-cache\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:18.095070 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.094959 5537 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-home\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:18.096490 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.096466 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59ed2e1-2c01-4b16-885a-b3535673a642-tls-certs" pod "e59ed2e1-2c01-4b16-885a-b3535673a642" (UID: "e59ed2e1-2c01-4b16-885a-b3535673a642"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:55:18.096675 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.096656 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-dshm" pod "e59ed2e1-2c01-4b16-885a-b3535673a642" (UID: "e59ed2e1-2c01-4b16-885a-b3535673a642"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:55:18.096771 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.096744 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59ed2e1-2c01-4b16-885a-b3535673a642-kube-api-access-bq927" pod "e59ed2e1-2c01-4b16-885a-b3535673a642" (UID: "e59ed2e1-2c01-4b16-885a-b3535673a642"). InnerVolumeSpecName "kube-api-access-bq927". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:55:18.195890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.195859 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq927\" (UniqueName: \"kubernetes.io/projected/e59ed2e1-2c01-4b16-885a-b3535673a642-kube-api-access-bq927\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:18.195890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.195888 5537 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e59ed2e1-2c01-4b16-885a-b3535673a642-tls-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:18.196085 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.195901 5537 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e59ed2e1-2c01-4b16-885a-b3535673a642-dshm\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:55:18.306028 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.305950 5537 generic.go:356] "Generic (PLEG): container finished" podID="e59ed2e1-2c01-4b16-885a-b3535673a642" containerID="7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f" exitCode=0 Nov 04 01:55:18.306028 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.305997 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" Nov 04 01:55:18.306212 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.306027 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" event={"ID":"e59ed2e1-2c01-4b16-885a-b3535673a642","Type":"ContainerDied","Data":"7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f"} Nov 04 01:55:18.306212 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.306068 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff" event={"ID":"e59ed2e1-2c01-4b16-885a-b3535673a642","Type":"ContainerDied","Data":"ee367df11010ee95359daf56b75e7399501e92f1d711c0f845030231f064d031"} Nov 04 01:55:18.306212 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.306087 5537 scope.go:122] "RemoveContainer" containerID="7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f" Nov 04 01:55:18.315315 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.315297 5537 scope.go:122] "RemoveContainer" containerID="7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f" Nov 04 01:55:18.315569 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:55:18.315552 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f\": container with ID starting with 7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f not found: ID does not exist" containerID="7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f" Nov 04 01:55:18.315669 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.315582 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f"} err="failed to get container status \"7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f\": rpc error: code = NotFound desc = could not find container \"7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f\": container with ID starting with 7ec3ff27aa4396b2abaadb9b560e3be1646af2885a448c3708cc25990578ac9f not found: ID does not exist" Nov 04 01:55:18.474733 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.474688 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff"] Nov 04 01:55:18.477648 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.477621 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-795045/simulator-w1-795045-kserve-7cfcd98f86-2g4ff"] Nov 04 01:55:18.677616 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:18.677533 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e59ed2e1-2c01-4b16-885a-b3535673a642" path="/var/lib/kubelet/pods/e59ed2e1-2c01-4b16-885a-b3535673a642/volumes" Nov 04 01:55:20.494024 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:55:20.493985 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:55:50.493574 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:55:50.493527 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:55:57.435181 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:57.435148 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm"] Nov 04 01:55:57.435727 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:55:57.435380 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" containerID="cri-o://94d5cf118d9065cef68de1fb4aeaa3c4bc7f600ca15ae9d6e13cb58b8dbf8148" gracePeriod=30 Nov 04 01:56:02.749331 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.749297 5537 generic.go:356] "Generic (PLEG): container finished" podID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerID="94d5cf118d9065cef68de1fb4aeaa3c4bc7f600ca15ae9d6e13cb58b8dbf8148" exitCode=0 Nov 04 01:56:02.749916 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.749344 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" event={"ID":"4e64bc64-e882-441f-b82b-d5144a7bdea2","Type":"ContainerDied","Data":"94d5cf118d9065cef68de1fb4aeaa3c4bc7f600ca15ae9d6e13cb58b8dbf8148"} Nov 04 01:56:02.750036 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.749979 5537 scope.go:122] "RemoveContainer" containerID="35043f885e8622601bef85aa1a156aa06776e1cd8d381b2f33c7f4e5e36bb550" Nov 04 01:56:02.799278 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.799252 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:56:02.848481 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.848450 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-data\") pod \"4e64bc64-e882-441f-b82b-d5144a7bdea2\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " Nov 04 01:56:02.848680 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.848499 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e64bc64-e882-441f-b82b-d5144a7bdea2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e64bc64-e882-441f-b82b-d5144a7bdea2-istiod-ca-cert\") pod \"4e64bc64-e882-441f-b82b-d5144a7bdea2\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " Nov 04 01:56:02.848680 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.848549 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-token\" (UniqueName: \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-token\") pod \"4e64bc64-e882-441f-b82b-d5144a7bdea2\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " Nov 04 01:56:02.848680 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.848578 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-kube-api-access-4n4zq\" (UniqueName: \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-kube-api-access-4n4zq\") pod \"4e64bc64-e882-441f-b82b-d5144a7bdea2\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " Nov 04 01:56:02.848680 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.848613 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-podinfo\") pod \"4e64bc64-e882-441f-b82b-d5144a7bdea2\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " Nov 04 01:56:02.848919 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.848704 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-socket\") pod \"4e64bc64-e882-441f-b82b-d5144a7bdea2\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " Nov 04 01:56:02.848919 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.848799 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-data" pod "4e64bc64-e882-441f-b82b-d5144a7bdea2" (UID: "4e64bc64-e882-441f-b82b-d5144a7bdea2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:56:02.848919 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.848823 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-envoy\") pod \"4e64bc64-e882-441f-b82b-d5144a7bdea2\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " Nov 04 01:56:02.849075 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.848934 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-certs\") pod \"4e64bc64-e882-441f-b82b-d5144a7bdea2\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " Nov 04 01:56:02.849075 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.848971 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-credential-socket\") pod \"4e64bc64-e882-441f-b82b-d5144a7bdea2\" (UID: \"4e64bc64-e882-441f-b82b-d5144a7bdea2\") " Nov 04 01:56:02.849075 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.849050 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-socket" pod "4e64bc64-e882-441f-b82b-d5144a7bdea2" (UID: "4e64bc64-e882-441f-b82b-d5144a7bdea2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:56:02.849075 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.849068 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e64bc64-e882-441f-b82b-d5144a7bdea2-istiod-ca-cert" pod "4e64bc64-e882-441f-b82b-d5144a7bdea2" (UID: "4e64bc64-e882-441f-b82b-d5144a7bdea2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:56:02.849285 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.849256 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-certs" pod "4e64bc64-e882-441f-b82b-d5144a7bdea2" (UID: "4e64bc64-e882-441f-b82b-d5144a7bdea2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:56:02.849349 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.849328 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-credential-socket" pod "4e64bc64-e882-441f-b82b-d5144a7bdea2" (UID: "4e64bc64-e882-441f-b82b-d5144a7bdea2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:56:02.849415 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.849399 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:02.849475 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.849422 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:02.849475 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.849438 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:02.849475 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.849452 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e64bc64-e882-441f-b82b-d5144a7bdea2-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:02.851162 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.851135 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-token" pod "4e64bc64-e882-441f-b82b-d5144a7bdea2" (UID: "4e64bc64-e882-441f-b82b-d5144a7bdea2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:56:02.851348 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.851330 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-podinfo" pod "4e64bc64-e882-441f-b82b-d5144a7bdea2" (UID: "4e64bc64-e882-441f-b82b-d5144a7bdea2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:56:02.851728 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.851705 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-kube-api-access-4n4zq" pod "4e64bc64-e882-441f-b82b-d5144a7bdea2" (UID: "4e64bc64-e882-441f-b82b-d5144a7bdea2"). InnerVolumeSpecName "kube-api-access-4n4zq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:56:02.851837 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.851738 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-envoy" pod "4e64bc64-e882-441f-b82b-d5144a7bdea2" (UID: "4e64bc64-e882-441f-b82b-d5144a7bdea2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:56:02.950387 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.950354 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:02.950387 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.950388 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:02.950602 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.950404 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n4zq\" (UniqueName: \"kubernetes.io/projected/4e64bc64-e882-441f-b82b-d5144a7bdea2-kube-api-access-4n4zq\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:02.950602 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.950418 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:02.950602 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:02.950432 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e64bc64-e882-441f-b82b-d5144a7bdea2-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:03.756898 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:03.756867 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" Nov 04 01:56:03.757386 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:03.756907 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm" event={"ID":"4e64bc64-e882-441f-b82b-d5144a7bdea2","Type":"ContainerDied","Data":"0832f95da42592e3e0cf2e3fd0684eb23f3ce07cdaa76ebc7fd05b3ad512a9b4"} Nov 04 01:56:03.757386 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:03.756964 5537 scope.go:122] "RemoveContainer" containerID="94d5cf118d9065cef68de1fb4aeaa3c4bc7f600ca15ae9d6e13cb58b8dbf8148" Nov 04 01:56:04.000303 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:03.999897 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm"] Nov 04 01:56:04.004430 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:04.003317 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-795045-openshift-default-85dbf685bc-28qrm"] Nov 04 01:56:04.643896 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:04.643862 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" path="/var/lib/kubelet/pods/4e64bc64-e882-441f-b82b-d5144a7bdea2/volumes" Nov 04 01:56:20.492255 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:56:20.492166 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:56:32.787480 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:32.787443 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g"] Nov 04 01:56:32.788063 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:32.787709 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" podUID="b37e6df0-1c12-4a96-aa60-826a92462955" containerName="maas-api" containerID="cri-o://fe94d8526245f825a3b2df8b5dbc5ae92f656792fd38640cdc9e0e518f0e28d0" gracePeriod=30 Nov 04 01:56:32.919463 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:32.919434 5537 generic.go:356] "Generic (PLEG): container finished" podID="b37e6df0-1c12-4a96-aa60-826a92462955" containerID="fe94d8526245f825a3b2df8b5dbc5ae92f656792fd38640cdc9e0e518f0e28d0" exitCode=0 Nov 04 01:56:32.919621 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:32.919506 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" event={"ID":"b37e6df0-1c12-4a96-aa60-826a92462955","Type":"ContainerDied","Data":"fe94d8526245f825a3b2df8b5dbc5ae92f656792fd38640cdc9e0e518f0e28d0"} Nov 04 01:56:33.095149 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.095123 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:56:33.131669 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.131632 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-maas-api-tls\") pod \"b37e6df0-1c12-4a96-aa60-826a92462955\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " Nov 04 01:56:33.131890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.131684 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-metrics-certs\") pod \"b37e6df0-1c12-4a96-aa60-826a92462955\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " Nov 04 01:56:33.131890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.131723 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b37e6df0-1c12-4a96-aa60-826a92462955-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37e6df0-1c12-4a96-aa60-826a92462955-openshift-service-ca\") pod \"b37e6df0-1c12-4a96-aa60-826a92462955\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " Nov 04 01:56:33.131890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.131867 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b37e6df0-1c12-4a96-aa60-826a92462955-kube-api-access-hfqgn\" (UniqueName: \"kubernetes.io/projected/b37e6df0-1c12-4a96-aa60-826a92462955-kube-api-access-hfqgn\") pod \"b37e6df0-1c12-4a96-aa60-826a92462955\" (UID: \"b37e6df0-1c12-4a96-aa60-826a92462955\") " Nov 04 01:56:33.132240 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.132215 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b37e6df0-1c12-4a96-aa60-826a92462955-openshift-service-ca" pod "b37e6df0-1c12-4a96-aa60-826a92462955" (UID: "b37e6df0-1c12-4a96-aa60-826a92462955"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:56:33.132393 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.132370 5537 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37e6df0-1c12-4a96-aa60-826a92462955-openshift-service-ca\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:33.134164 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.134135 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b37e6df0-1c12-4a96-aa60-826a92462955-kube-api-access-hfqgn" pod "b37e6df0-1c12-4a96-aa60-826a92462955" (UID: "b37e6df0-1c12-4a96-aa60-826a92462955"). InnerVolumeSpecName "kube-api-access-hfqgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:56:33.134164 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.134150 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-metrics-certs" pod "b37e6df0-1c12-4a96-aa60-826a92462955" (UID: "b37e6df0-1c12-4a96-aa60-826a92462955"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:56:33.134164 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.134135 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-maas-api-tls" pod "b37e6df0-1c12-4a96-aa60-826a92462955" (UID: "b37e6df0-1c12-4a96-aa60-826a92462955"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:56:33.236870 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.236832 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfqgn\" (UniqueName: \"kubernetes.io/projected/b37e6df0-1c12-4a96-aa60-826a92462955-kube-api-access-hfqgn\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:33.236870 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.236869 5537 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-maas-api-tls\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:33.237156 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.236882 5537 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b37e6df0-1c12-4a96-aa60-826a92462955-metrics-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:33.925796 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.925763 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" Nov 04 01:56:33.926253 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.925809 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g" event={"ID":"b37e6df0-1c12-4a96-aa60-826a92462955","Type":"ContainerDied","Data":"846ef6e6857d10e3790e784ad2b60eeb9a8ac1733ef8e919f1a05bab67be6b98"} Nov 04 01:56:33.926253 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:33.925868 5537 scope.go:122] "RemoveContainer" containerID="fe94d8526245f825a3b2df8b5dbc5ae92f656792fd38640cdc9e0e518f0e28d0" Nov 04 01:56:34.091480 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:34.091441 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g"] Nov 04 01:56:34.140810 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:34.140747 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-c0ab5f-6df4d44977-2fk5g"] Nov 04 01:56:34.643901 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:34.643866 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b37e6df0-1c12-4a96-aa60-826a92462955" path="/var/lib/kubelet/pods/b37e6df0-1c12-4a96-aa60-826a92462955/volumes" Nov 04 01:56:37.465420 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:37.465391 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt"] Nov 04 01:56:37.465855 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:37.465623 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" containerID="cri-o://b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd" gracePeriod=30 Nov 04 01:56:39.894835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:39.889973 5537 patch_prober.go:29] interesting pod/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 01:56:39.894835 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:39.890075 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 01:56:42.721554 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.721527 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:56:42.751842 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.751814 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-envoy\") pod \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " Nov 04 01:56:42.751985 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.751928 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-kube-api-access-6x68l\" (UniqueName: \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-kube-api-access-6x68l\") pod \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " Nov 04 01:56:42.751985 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.751963 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istiod-ca-cert\") pod \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " Nov 04 01:56:42.752065 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752002 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-certs\") pod \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " Nov 04 01:56:42.752164 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752114 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-socket\") pod \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " Nov 04 01:56:42.752164 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752152 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-data\") pod \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " Nov 04 01:56:42.752360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752196 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-token\" (UniqueName: \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-token\") pod \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " Nov 04 01:56:42.752360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752234 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-podinfo\") pod \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " Nov 04 01:56:42.752360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752272 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-certs" pod "522a1ef4-7857-445b-94e0-bfa71bdf42e8" (UID: "522a1ef4-7857-445b-94e0-bfa71bdf42e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:56:42.752360 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752289 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-credential-socket\") pod \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\" (UID: \"522a1ef4-7857-445b-94e0-bfa71bdf42e8\") " Nov 04 01:56:42.752655 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752361 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-socket" pod "522a1ef4-7857-445b-94e0-bfa71bdf42e8" (UID: "522a1ef4-7857-445b-94e0-bfa71bdf42e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:56:42.752655 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752377 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istiod-ca-cert" pod "522a1ef4-7857-445b-94e0-bfa71bdf42e8" (UID: "522a1ef4-7857-445b-94e0-bfa71bdf42e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:56:42.752655 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752385 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-data" pod "522a1ef4-7857-445b-94e0-bfa71bdf42e8" (UID: "522a1ef4-7857-445b-94e0-bfa71bdf42e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:56:42.753007 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752839 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:42.753007 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752862 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:42.753007 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752914 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-credential-socket" pod "522a1ef4-7857-445b-94e0-bfa71bdf42e8" (UID: "522a1ef4-7857-445b-94e0-bfa71bdf42e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:56:42.753167 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.752977 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:42.753167 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.753052 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:42.754289 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.754260 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-envoy" pod "522a1ef4-7857-445b-94e0-bfa71bdf42e8" (UID: "522a1ef4-7857-445b-94e0-bfa71bdf42e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:56:42.754482 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.754464 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-kube-api-access-6x68l" pod "522a1ef4-7857-445b-94e0-bfa71bdf42e8" (UID: "522a1ef4-7857-445b-94e0-bfa71bdf42e8"). InnerVolumeSpecName "kube-api-access-6x68l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:56:42.754482 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.754471 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-token" pod "522a1ef4-7857-445b-94e0-bfa71bdf42e8" (UID: "522a1ef4-7857-445b-94e0-bfa71bdf42e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:56:42.754708 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.754695 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-podinfo" pod "522a1ef4-7857-445b-94e0-bfa71bdf42e8" (UID: "522a1ef4-7857-445b-94e0-bfa71bdf42e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:56:42.854015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.853983 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x68l\" (UniqueName: \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-kube-api-access-6x68l\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:42.854015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.854010 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:42.854015 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.854021 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:42.854267 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.854029 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:42.854267 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.854038 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522a1ef4-7857-445b-94e0-bfa71bdf42e8-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:56:42.975945 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.975911 5537 generic.go:356] "Generic (PLEG): container finished" podID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerID="b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd" exitCode=0 Nov 04 01:56:42.976144 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.975960 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" Nov 04 01:56:42.976144 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.975993 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" event={"ID":"522a1ef4-7857-445b-94e0-bfa71bdf42e8","Type":"ContainerDied","Data":"b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd"} Nov 04 01:56:42.976144 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.976057 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt" event={"ID":"522a1ef4-7857-445b-94e0-bfa71bdf42e8","Type":"ContainerDied","Data":"415d516f8d4234409485fad49ad2712e8dcdebf7e6310023409a3b4db131f282"} Nov 04 01:56:42.976144 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.976088 5537 scope.go:122] "RemoveContainer" containerID="b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd" Nov 04 01:56:42.988554 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.987436 5537 scope.go:122] "RemoveContainer" containerID="c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755" Nov 04 01:56:42.997307 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.997289 5537 scope.go:122] "RemoveContainer" containerID="b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd" Nov 04 01:56:42.997575 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:56:42.997557 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd\": container with ID starting with b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd not found: ID does not exist" containerID="b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd" Nov 04 01:56:42.997623 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.997584 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd"} err="failed to get container status \"b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd\": rpc error: code = NotFound desc = could not find container \"b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd\": container with ID starting with b9917d9c6b8ca01eb21795c98abec9605817871b0a69471e806829e3e028dbcd not found: ID does not exist" Nov 04 01:56:42.997623 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.997602 5537 scope.go:122] "RemoveContainer" containerID="c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755" Nov 04 01:56:42.997874 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:56:42.997854 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755\": container with ID starting with c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755 not found: ID does not exist" containerID="c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755" Nov 04 01:56:42.997968 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:42.997881 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755"} err="failed to get container status \"c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755\": rpc error: code = NotFound desc = could not find container \"c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755\": container with ID starting with c3f7b4750ed6f9d92edf8d4413426579e0ba9f7c489f58ff12fdc1b816e91755 not found: ID does not exist" Nov 04 01:56:43.139691 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:43.139610 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt"] Nov 04 01:56:43.146707 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:43.146682 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-c0ab5f-openshift-default-8977b7949-b2qvt"] Nov 04 01:56:44.644019 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:56:44.643979 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" path="/var/lib/kubelet/pods/522a1ef4-7857-445b-94e0-bfa71bdf42e8/volumes" Nov 04 01:56:50.493333 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:56:50.493292 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:57:20.492937 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:57:20.492902 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:57:24.206661 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:24.206632 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5"] Nov 04 01:57:24.207185 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:24.206856 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" containerID="cri-o://38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572" gracePeriod=30 Nov 04 01:57:29.464030 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.464000 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:57:29.568931 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.568897 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-socket\") pod \"7b93cf7a-3a09-4643-8e00-30513a096dcb\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " Nov 04 01:57:29.569111 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569013 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-data\") pod \"7b93cf7a-3a09-4643-8e00-30513a096dcb\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " Nov 04 01:57:29.569111 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569030 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-envoy\") pod \"7b93cf7a-3a09-4643-8e00-30513a096dcb\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " Nov 04 01:57:29.569111 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569060 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-kube-api-access-hgr9n\" (UniqueName: \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-kube-api-access-hgr9n\") pod \"7b93cf7a-3a09-4643-8e00-30513a096dcb\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " Nov 04 01:57:29.569111 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569099 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-token\" (UniqueName: \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-token\") pod \"7b93cf7a-3a09-4643-8e00-30513a096dcb\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " Nov 04 01:57:29.569319 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569140 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-credential-socket\") pod \"7b93cf7a-3a09-4643-8e00-30513a096dcb\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " Nov 04 01:57:29.569319 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569144 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-socket" pod "7b93cf7a-3a09-4643-8e00-30513a096dcb" (UID: "7b93cf7a-3a09-4643-8e00-30513a096dcb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:57:29.569319 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569175 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-certs\") pod \"7b93cf7a-3a09-4643-8e00-30513a096dcb\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " Nov 04 01:57:29.569319 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569209 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b93cf7a-3a09-4643-8e00-30513a096dcb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b93cf7a-3a09-4643-8e00-30513a096dcb-istiod-ca-cert\") pod \"7b93cf7a-3a09-4643-8e00-30513a096dcb\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " Nov 04 01:57:29.569319 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569251 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-podinfo\") pod \"7b93cf7a-3a09-4643-8e00-30513a096dcb\" (UID: \"7b93cf7a-3a09-4643-8e00-30513a096dcb\") " Nov 04 01:57:29.569517 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569343 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-data" pod "7b93cf7a-3a09-4643-8e00-30513a096dcb" (UID: "7b93cf7a-3a09-4643-8e00-30513a096dcb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:57:29.569517 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569449 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-certs" pod "7b93cf7a-3a09-4643-8e00-30513a096dcb" (UID: "7b93cf7a-3a09-4643-8e00-30513a096dcb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:57:29.569625 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569570 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-credential-socket" pod "7b93cf7a-3a09-4643-8e00-30513a096dcb" (UID: "7b93cf7a-3a09-4643-8e00-30513a096dcb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:57:29.569678 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569652 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b93cf7a-3a09-4643-8e00-30513a096dcb-istiod-ca-cert" pod "7b93cf7a-3a09-4643-8e00-30513a096dcb" (UID: "7b93cf7a-3a09-4643-8e00-30513a096dcb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:57:29.569836 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569765 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:29.569836 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569811 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:29.569836 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569829 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:29.570169 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569842 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b93cf7a-3a09-4643-8e00-30513a096dcb-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:29.570169 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.569855 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:29.571576 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.571552 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-token" pod "7b93cf7a-3a09-4643-8e00-30513a096dcb" (UID: "7b93cf7a-3a09-4643-8e00-30513a096dcb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:57:29.571706 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.571673 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-podinfo" pod "7b93cf7a-3a09-4643-8e00-30513a096dcb" (UID: "7b93cf7a-3a09-4643-8e00-30513a096dcb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:57:29.572057 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.572032 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-envoy" pod "7b93cf7a-3a09-4643-8e00-30513a096dcb" (UID: "7b93cf7a-3a09-4643-8e00-30513a096dcb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:57:29.572154 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.572066 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-kube-api-access-hgr9n" pod "7b93cf7a-3a09-4643-8e00-30513a096dcb" (UID: "7b93cf7a-3a09-4643-8e00-30513a096dcb"). InnerVolumeSpecName "kube-api-access-hgr9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:57:29.671182 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.671149 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgr9n\" (UniqueName: \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-kube-api-access-hgr9n\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:29.671182 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.671176 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:29.671182 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.671186 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:29.671441 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:29.671195 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b93cf7a-3a09-4643-8e00-30513a096dcb-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:30.291975 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.291939 5537 generic.go:356] "Generic (PLEG): container finished" podID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerID="38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572" exitCode=0 Nov 04 01:57:30.292150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.292004 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" Nov 04 01:57:30.292150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.292023 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" event={"ID":"7b93cf7a-3a09-4643-8e00-30513a096dcb","Type":"ContainerDied","Data":"38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572"} Nov 04 01:57:30.292150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.292109 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5" event={"ID":"7b93cf7a-3a09-4643-8e00-30513a096dcb","Type":"ContainerDied","Data":"41e79eaf8e2b6c8dda310d4d3ff86d0bf9a6fc4729538582c92d405337c85e48"} Nov 04 01:57:30.292150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.292133 5537 scope.go:122] "RemoveContainer" containerID="38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572" Nov 04 01:57:30.301920 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.301898 5537 scope.go:122] "RemoveContainer" containerID="203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293" Nov 04 01:57:30.310244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.310222 5537 scope.go:122] "RemoveContainer" containerID="38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572" Nov 04 01:57:30.310532 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:57:30.310502 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572\": container with ID starting with 38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572 not found: ID does not exist" containerID="38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572" Nov 04 01:57:30.310571 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.310542 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572"} err="failed to get container status \"38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572\": rpc error: code = NotFound desc = could not find container \"38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572\": container with ID starting with 38a7ae438ec9902295133cf30d11b8f2d2dd9f83adf11481fd3094f2f3678572 not found: ID does not exist" Nov 04 01:57:30.310571 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.310559 5537 scope.go:122] "RemoveContainer" containerID="203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293" Nov 04 01:57:30.310825 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:57:30.310807 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293\": container with ID starting with 203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293 not found: ID does not exist" containerID="203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293" Nov 04 01:57:30.310888 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.310829 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293"} err="failed to get container status \"203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293\": rpc error: code = NotFound desc = could not find container \"203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293\": container with ID starting with 203cf029e84329dbcc25d65ce3e76521f498a2fb1da941d0527436bbc1f35293 not found: ID does not exist" Nov 04 01:57:30.456021 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.455985 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5"] Nov 04 01:57:30.505293 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.505264 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-fa0149-openshift-default-84d4d9bf85-cnkt5"] Nov 04 01:57:30.643136 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:30.643057 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" path="/var/lib/kubelet/pods/7b93cf7a-3a09-4643-8e00-30513a096dcb/volumes" Nov 04 01:57:38.848403 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:38.848363 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f"] Nov 04 01:57:38.848954 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:38.848609 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" podUID="a9896732-3c47-4d0a-80d8-6e02c134dd18" containerName="maas-api" containerID="cri-o://b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d" gracePeriod=30 Nov 04 01:57:39.132945 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.132921 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:57:39.185224 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.185190 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9896732-3c47-4d0a-80d8-6e02c134dd18-kube-api-access-qd2v2\" (UniqueName: \"kubernetes.io/projected/a9896732-3c47-4d0a-80d8-6e02c134dd18-kube-api-access-qd2v2\") pod \"a9896732-3c47-4d0a-80d8-6e02c134dd18\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " Nov 04 01:57:39.185418 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.185347 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-maas-api-tls\") pod \"a9896732-3c47-4d0a-80d8-6e02c134dd18\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " Nov 04 01:57:39.185483 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.185430 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a9896732-3c47-4d0a-80d8-6e02c134dd18-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9896732-3c47-4d0a-80d8-6e02c134dd18-openshift-service-ca\") pod \"a9896732-3c47-4d0a-80d8-6e02c134dd18\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " Nov 04 01:57:39.185483 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.185460 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-metrics-certs\") pod \"a9896732-3c47-4d0a-80d8-6e02c134dd18\" (UID: \"a9896732-3c47-4d0a-80d8-6e02c134dd18\") " Nov 04 01:57:39.185832 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.185773 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9896732-3c47-4d0a-80d8-6e02c134dd18-openshift-service-ca" pod "a9896732-3c47-4d0a-80d8-6e02c134dd18" (UID: "a9896732-3c47-4d0a-80d8-6e02c134dd18"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:57:39.187444 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.187423 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9896732-3c47-4d0a-80d8-6e02c134dd18-kube-api-access-qd2v2" pod "a9896732-3c47-4d0a-80d8-6e02c134dd18" (UID: "a9896732-3c47-4d0a-80d8-6e02c134dd18"). InnerVolumeSpecName "kube-api-access-qd2v2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:57:39.187609 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.187583 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-metrics-certs" pod "a9896732-3c47-4d0a-80d8-6e02c134dd18" (UID: "a9896732-3c47-4d0a-80d8-6e02c134dd18"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:57:39.187654 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.187592 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-maas-api-tls" pod "a9896732-3c47-4d0a-80d8-6e02c134dd18" (UID: "a9896732-3c47-4d0a-80d8-6e02c134dd18"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:57:39.286700 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.286671 5537 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-maas-api-tls\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:39.286700 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.286698 5537 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9896732-3c47-4d0a-80d8-6e02c134dd18-openshift-service-ca\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:39.286700 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.286708 5537 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9896732-3c47-4d0a-80d8-6e02c134dd18-metrics-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:39.286952 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.286716 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd2v2\" (UniqueName: \"kubernetes.io/projected/a9896732-3c47-4d0a-80d8-6e02c134dd18-kube-api-access-qd2v2\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:39.344477 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.344438 5537 generic.go:356] "Generic (PLEG): container finished" podID="a9896732-3c47-4d0a-80d8-6e02c134dd18" containerID="b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d" exitCode=0 Nov 04 01:57:39.344624 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.344502 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" event={"ID":"a9896732-3c47-4d0a-80d8-6e02c134dd18","Type":"ContainerDied","Data":"b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d"} Nov 04 01:57:39.344624 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.344505 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" Nov 04 01:57:39.344624 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.344573 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f" event={"ID":"a9896732-3c47-4d0a-80d8-6e02c134dd18","Type":"ContainerDied","Data":"5532b2403c726e14bfa45150f0d63f450e630843b8b8bc4c8b3f65e4ac888568"} Nov 04 01:57:39.344624 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.344595 5537 scope.go:122] "RemoveContainer" containerID="b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d" Nov 04 01:57:39.354624 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.354606 5537 scope.go:122] "RemoveContainer" containerID="b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d" Nov 04 01:57:39.354919 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:57:39.354900 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d\": container with ID starting with b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d not found: ID does not exist" containerID="b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d" Nov 04 01:57:39.354989 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.354927 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d"} err="failed to get container status \"b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d\": rpc error: code = NotFound desc = could not find container \"b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d\": container with ID starting with b1e2c7f98e80d3504b8271226032d06438c04dce3c2cc86ae05784dd8b96ba7d not found: ID does not exist" Nov 04 01:57:39.509594 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.509563 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f"] Nov 04 01:57:39.513616 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:39.513589 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-79badd-644c866cdd-xsq8f"] Nov 04 01:57:40.643633 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:40.643600 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9896732-3c47-4d0a-80d8-6e02c134dd18" path="/var/lib/kubelet/pods/a9896732-3c47-4d0a-80d8-6e02c134dd18/volumes" Nov 04 01:57:43.819401 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:43.819369 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc"] Nov 04 01:57:43.819924 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:43.819624 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" containerID="cri-o://3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989" gracePeriod=30 Nov 04 01:57:46.130794 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:46.130745 5537 patch_prober.go:29] interesting pod/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 01:57:46.131182 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:46.130827 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 01:57:49.087895 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.087828 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:57:49.243230 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243193 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-istio-token\" (UniqueName: \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-istio-token\") pod \"89a932f5-c594-4ca1-9f76-6551146d4209\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " Nov 04 01:57:49.243424 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243320 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-certs\") pod \"89a932f5-c594-4ca1-9f76-6551146d4209\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " Nov 04 01:57:49.243424 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243370 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/89a932f5-c594-4ca1-9f76-6551146d4209-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89a932f5-c594-4ca1-9f76-6551146d4209-istiod-ca-cert\") pod \"89a932f5-c594-4ca1-9f76-6551146d4209\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " Nov 04 01:57:49.243424 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243396 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/89a932f5-c594-4ca1-9f76-6551146d4209-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89a932f5-c594-4ca1-9f76-6551146d4209-istio-podinfo\") pod \"89a932f5-c594-4ca1-9f76-6551146d4209\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " Nov 04 01:57:49.243596 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243453 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-socket\") pod \"89a932f5-c594-4ca1-9f76-6551146d4209\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " Nov 04 01:57:49.243596 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243490 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-kube-api-access-97gms\" (UniqueName: \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-kube-api-access-97gms\") pod \"89a932f5-c594-4ca1-9f76-6551146d4209\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " Nov 04 01:57:49.243596 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243527 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-credential-socket\") pod \"89a932f5-c594-4ca1-9f76-6551146d4209\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " Nov 04 01:57:49.243596 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243587 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-envoy\") pod \"89a932f5-c594-4ca1-9f76-6551146d4209\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " Nov 04 01:57:49.243846 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243633 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-certs" pod "89a932f5-c594-4ca1-9f76-6551146d4209" (UID: "89a932f5-c594-4ca1-9f76-6551146d4209"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:57:49.243846 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243642 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-data\") pod \"89a932f5-c594-4ca1-9f76-6551146d4209\" (UID: \"89a932f5-c594-4ca1-9f76-6551146d4209\") " Nov 04 01:57:49.243846 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243723 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-socket" pod "89a932f5-c594-4ca1-9f76-6551146d4209" (UID: "89a932f5-c594-4ca1-9f76-6551146d4209"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:57:49.243846 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243732 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a932f5-c594-4ca1-9f76-6551146d4209-istiod-ca-cert" pod "89a932f5-c594-4ca1-9f76-6551146d4209" (UID: "89a932f5-c594-4ca1-9f76-6551146d4209"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:57:49.244047 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.243883 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-data" pod "89a932f5-c594-4ca1-9f76-6551146d4209" (UID: "89a932f5-c594-4ca1-9f76-6551146d4209"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:57:49.244094 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.244071 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-credential-socket" pod "89a932f5-c594-4ca1-9f76-6551146d4209" (UID: "89a932f5-c594-4ca1-9f76-6551146d4209"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:57:49.244244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.244229 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:49.244316 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.244247 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89a932f5-c594-4ca1-9f76-6551146d4209-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:49.244316 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.244255 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:49.244316 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.244264 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:49.244316 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.244273 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:49.245826 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.245792 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-istio-token" pod "89a932f5-c594-4ca1-9f76-6551146d4209" (UID: "89a932f5-c594-4ca1-9f76-6551146d4209"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:57:49.245826 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.245775 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89a932f5-c594-4ca1-9f76-6551146d4209-istio-podinfo" pod "89a932f5-c594-4ca1-9f76-6551146d4209" (UID: "89a932f5-c594-4ca1-9f76-6551146d4209"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:57:49.246182 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.246163 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-envoy" pod "89a932f5-c594-4ca1-9f76-6551146d4209" (UID: "89a932f5-c594-4ca1-9f76-6551146d4209"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:57:49.246239 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.246209 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-kube-api-access-97gms" pod "89a932f5-c594-4ca1-9f76-6551146d4209" (UID: "89a932f5-c594-4ca1-9f76-6551146d4209"). InnerVolumeSpecName "kube-api-access-97gms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:57:49.345979 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.345894 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89a932f5-c594-4ca1-9f76-6551146d4209-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:49.345979 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.345922 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:49.345979 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.345931 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89a932f5-c594-4ca1-9f76-6551146d4209-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:49.345979 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.345942 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97gms\" (UniqueName: \"kubernetes.io/projected/89a932f5-c594-4ca1-9f76-6551146d4209-kube-api-access-97gms\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:57:49.395373 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.395335 5537 generic.go:356] "Generic (PLEG): container finished" podID="89a932f5-c594-4ca1-9f76-6551146d4209" containerID="3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989" exitCode=0 Nov 04 01:57:49.395552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.395383 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" Nov 04 01:57:49.395552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.395406 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" event={"ID":"89a932f5-c594-4ca1-9f76-6551146d4209","Type":"ContainerDied","Data":"3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989"} Nov 04 01:57:49.395552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.395492 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc" event={"ID":"89a932f5-c594-4ca1-9f76-6551146d4209","Type":"ContainerDied","Data":"020bf015521799a2c728fd9b0676ed06188281683b4fb715e8a5916733aee13f"} Nov 04 01:57:49.395552 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.395516 5537 scope.go:122] "RemoveContainer" containerID="3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989" Nov 04 01:57:49.405576 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.405558 5537 scope.go:122] "RemoveContainer" containerID="4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e" Nov 04 01:57:49.414306 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.414290 5537 scope.go:122] "RemoveContainer" containerID="3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989" Nov 04 01:57:49.414580 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:57:49.414562 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989\": container with ID starting with 3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989 not found: ID does not exist" containerID="3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989" Nov 04 01:57:49.414652 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.414590 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989"} err="failed to get container status \"3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989\": rpc error: code = NotFound desc = could not find container \"3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989\": container with ID starting with 3984554744f503e9d5b384a48ec2df3395dd8dd643defed64d1a56f210f64989 not found: ID does not exist" Nov 04 01:57:49.414652 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.414609 5537 scope.go:122] "RemoveContainer" containerID="4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e" Nov 04 01:57:49.414886 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:57:49.414867 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e\": container with ID starting with 4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e not found: ID does not exist" containerID="4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e" Nov 04 01:57:49.414998 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.414892 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e"} err="failed to get container status \"4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e\": rpc error: code = NotFound desc = could not find container \"4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e\": container with ID starting with 4ea8fddbf19ca3737aba4dca70b283f3b93a782213971bf1246a1bbb505bc34e not found: ID does not exist" Nov 04 01:57:49.558108 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.558070 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc"] Nov 04 01:57:49.564173 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:49.564155 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-79badd-openshift-default-68df55b6df-hh2fc"] Nov 04 01:57:50.496636 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:57:50.496601 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:57:50.644292 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:50.644260 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" path="/var/lib/kubelet/pods/89a932f5-c594-4ca1-9f76-6551146d4209/volumes" Nov 04 01:57:58.322830 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:58.322793 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn"] Nov 04 01:57:58.323382 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:57:58.323026 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" containerID="cri-o://556f608ef1224937ed076e551085c284606ff2d52265436c9a07f5524f389a06" gracePeriod=30 Nov 04 01:58:03.486829 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.486760 5537 generic.go:356] "Generic (PLEG): container finished" podID="a394a024-f25d-474b-aff6-0f4194bf0659" containerID="556f608ef1224937ed076e551085c284606ff2d52265436c9a07f5524f389a06" exitCode=0 Nov 04 01:58:03.487311 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.486837 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" event={"ID":"a394a024-f25d-474b-aff6-0f4194bf0659","Type":"ContainerDied","Data":"556f608ef1224937ed076e551085c284606ff2d52265436c9a07f5524f389a06"} Nov 04 01:58:03.574326 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.574302 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:58:03.636412 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636343 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-credential-socket\") pod \"a394a024-f25d-474b-aff6-0f4194bf0659\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " Nov 04 01:58:03.636412 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636390 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-data\") pod \"a394a024-f25d-474b-aff6-0f4194bf0659\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " Nov 04 01:58:03.636576 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636448 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-certs\") pod \"a394a024-f25d-474b-aff6-0f4194bf0659\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " Nov 04 01:58:03.636576 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636510 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-socket\") pod \"a394a024-f25d-474b-aff6-0f4194bf0659\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " Nov 04 01:58:03.636576 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636560 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a394a024-f25d-474b-aff6-0f4194bf0659-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a394a024-f25d-474b-aff6-0f4194bf0659-istiod-ca-cert\") pod \"a394a024-f25d-474b-aff6-0f4194bf0659\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " Nov 04 01:58:03.636711 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636587 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-envoy\") pod \"a394a024-f25d-474b-aff6-0f4194bf0659\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " Nov 04 01:58:03.636711 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636594 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-credential-socket" pod "a394a024-f25d-474b-aff6-0f4194bf0659" (UID: "a394a024-f25d-474b-aff6-0f4194bf0659"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:03.636711 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636616 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-kube-api-access-s7vp7\" (UniqueName: \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-kube-api-access-s7vp7\") pod \"a394a024-f25d-474b-aff6-0f4194bf0659\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " Nov 04 01:58:03.636711 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636646 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a394a024-f25d-474b-aff6-0f4194bf0659-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a394a024-f25d-474b-aff6-0f4194bf0659-istio-podinfo\") pod \"a394a024-f25d-474b-aff6-0f4194bf0659\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " Nov 04 01:58:03.636711 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636680 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-istio-token\" (UniqueName: \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-istio-token\") pod \"a394a024-f25d-474b-aff6-0f4194bf0659\" (UID: \"a394a024-f25d-474b-aff6-0f4194bf0659\") " Nov 04 01:58:03.636711 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636695 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-data" pod "a394a024-f25d-474b-aff6-0f4194bf0659" (UID: "a394a024-f25d-474b-aff6-0f4194bf0659"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:03.637056 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636817 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-certs" pod "a394a024-f25d-474b-aff6-0f4194bf0659" (UID: "a394a024-f25d-474b-aff6-0f4194bf0659"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:03.637056 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.636842 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-socket" pod "a394a024-f25d-474b-aff6-0f4194bf0659" (UID: "a394a024-f25d-474b-aff6-0f4194bf0659"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:03.637173 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.637061 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a394a024-f25d-474b-aff6-0f4194bf0659-istiod-ca-cert" pod "a394a024-f25d-474b-aff6-0f4194bf0659" (UID: "a394a024-f25d-474b-aff6-0f4194bf0659"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:58:03.637228 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.637207 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a394a024-f25d-474b-aff6-0f4194bf0659-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:03.637228 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.637225 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:03.637327 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.637236 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:03.637327 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.637245 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:03.637327 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.637253 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:03.638977 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.638955 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-envoy" pod "a394a024-f25d-474b-aff6-0f4194bf0659" (UID: "a394a024-f25d-474b-aff6-0f4194bf0659"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:03.639090 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.639008 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a394a024-f25d-474b-aff6-0f4194bf0659-istio-podinfo" pod "a394a024-f25d-474b-aff6-0f4194bf0659" (UID: "a394a024-f25d-474b-aff6-0f4194bf0659"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:58:03.639338 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.639314 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-istio-token" pod "a394a024-f25d-474b-aff6-0f4194bf0659" (UID: "a394a024-f25d-474b-aff6-0f4194bf0659"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:58:03.639429 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.639314 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-kube-api-access-s7vp7" pod "a394a024-f25d-474b-aff6-0f4194bf0659" (UID: "a394a024-f25d-474b-aff6-0f4194bf0659"). InnerVolumeSpecName "kube-api-access-s7vp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:58:03.742806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.738375 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a394a024-f25d-474b-aff6-0f4194bf0659-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:03.743989 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.738686 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7vp7\" (UniqueName: \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-kube-api-access-s7vp7\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:03.744189 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.744173 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a394a024-f25d-474b-aff6-0f4194bf0659-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:03.744292 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:03.744281 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a394a024-f25d-474b-aff6-0f4194bf0659-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:04.493256 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:04.493220 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" event={"ID":"a394a024-f25d-474b-aff6-0f4194bf0659","Type":"ContainerDied","Data":"ee1a0111b434747ca023f9e9a271c4b3a2ffee0187a40c816cbc3ec59b0bd9dc"} Nov 04 01:58:04.493808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:04.493285 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn" Nov 04 01:58:04.493808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:04.493306 5537 scope.go:122] "RemoveContainer" containerID="556f608ef1224937ed076e551085c284606ff2d52265436c9a07f5524f389a06" Nov 04 01:58:04.709137 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:04.709104 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn"] Nov 04 01:58:04.758416 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:04.758384 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-4h4mn"] Nov 04 01:58:06.642746 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:06.642716 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" path="/var/lib/kubelet/pods/a394a024-f25d-474b-aff6-0f4194bf0659/volumes" Nov 04 01:58:10.215945 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:10.215900 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg"] Nov 04 01:58:20.492837 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:58:20.492803 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:58:25.236643 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.236596 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" podUID="c9218427-91b8-49b2-951c-00654714c72f" containerName="main" containerID="cri-o://0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196" gracePeriod=45 Nov 04 01:58:25.509966 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.509939 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:58:25.598323 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.598290 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-home\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-home\") pod \"c9218427-91b8-49b2-951c-00654714c72f\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " Nov 04 01:58:25.598493 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.598347 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-dshm\") pod \"c9218427-91b8-49b2-951c-00654714c72f\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " Nov 04 01:58:25.598493 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.598426 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-model-cache\") pod \"c9218427-91b8-49b2-951c-00654714c72f\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " Nov 04 01:58:25.598493 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.598477 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c9218427-91b8-49b2-951c-00654714c72f-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9218427-91b8-49b2-951c-00654714c72f-tls-certs\") pod \"c9218427-91b8-49b2-951c-00654714c72f\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " Nov 04 01:58:25.598626 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.598558 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9218427-91b8-49b2-951c-00654714c72f-kube-api-access-kg448\" (UniqueName: \"kubernetes.io/projected/c9218427-91b8-49b2-951c-00654714c72f-kube-api-access-kg448\") pod \"c9218427-91b8-49b2-951c-00654714c72f\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " Nov 04 01:58:25.598626 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.598572 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-home" pod "c9218427-91b8-49b2-951c-00654714c72f" (UID: "c9218427-91b8-49b2-951c-00654714c72f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:25.598626 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.598601 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-tmp-dir\") pod \"c9218427-91b8-49b2-951c-00654714c72f\" (UID: \"c9218427-91b8-49b2-951c-00654714c72f\") " Nov 04 01:58:25.598796 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.598702 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-model-cache" pod "c9218427-91b8-49b2-951c-00654714c72f" (UID: "c9218427-91b8-49b2-951c-00654714c72f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:25.599063 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.598940 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-tmp-dir" pod "c9218427-91b8-49b2-951c-00654714c72f" (UID: "c9218427-91b8-49b2-951c-00654714c72f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:25.599063 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.599017 5537 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-model-cache\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:25.599063 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.599029 5537 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-tmp-dir\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:25.599063 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.599045 5537 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-home\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:25.600972 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.600949 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-dshm" pod "c9218427-91b8-49b2-951c-00654714c72f" (UID: "c9218427-91b8-49b2-951c-00654714c72f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:25.601101 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.601073 5537 generic.go:356] "Generic (PLEG): container finished" podID="c9218427-91b8-49b2-951c-00654714c72f" containerID="0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196" exitCode=0 Nov 04 01:58:25.601188 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.601141 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" event={"ID":"c9218427-91b8-49b2-951c-00654714c72f","Type":"ContainerDied","Data":"0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196"} Nov 04 01:58:25.601253 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.601189 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" event={"ID":"c9218427-91b8-49b2-951c-00654714c72f","Type":"ContainerDied","Data":"638d0bd8890cef3fc389ec7b56a421b23e327d116ed13fc7792becd2b2904746"} Nov 04 01:58:25.601253 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.601218 5537 scope.go:122] "RemoveContainer" containerID="0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196" Nov 04 01:58:25.601253 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.601149 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg" Nov 04 01:58:25.605175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.605145 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9218427-91b8-49b2-951c-00654714c72f-tls-certs" pod "c9218427-91b8-49b2-951c-00654714c72f" (UID: "c9218427-91b8-49b2-951c-00654714c72f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:58:25.605279 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.605187 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9218427-91b8-49b2-951c-00654714c72f-kube-api-access-kg448" pod "c9218427-91b8-49b2-951c-00654714c72f" (UID: "c9218427-91b8-49b2-951c-00654714c72f"). InnerVolumeSpecName "kube-api-access-kg448". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:58:25.622386 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.622364 5537 scope.go:122] "RemoveContainer" containerID="0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196" Nov 04 01:58:25.622703 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:58:25.622677 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196\": container with ID starting with 0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196 not found: ID does not exist" containerID="0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196" Nov 04 01:58:25.622839 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.622715 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196"} err="failed to get container status \"0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196\": rpc error: code = NotFound desc = could not find container \"0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196\": container with ID starting with 0dac32c175abd28a347580ae7f7433cadef69e87879443df8ff1e187927b0196 not found: ID does not exist" Nov 04 01:58:25.700605 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.700577 5537 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9218427-91b8-49b2-951c-00654714c72f-tls-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:25.700605 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.700605 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg448\" (UniqueName: \"kubernetes.io/projected/c9218427-91b8-49b2-951c-00654714c72f-kube-api-access-kg448\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:25.700865 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:25.700618 5537 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9218427-91b8-49b2-951c-00654714c72f-dshm\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:26.019548 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:26.019512 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg"] Nov 04 01:58:26.068720 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:26.068685 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-82706f/premium-w2-82706f-kserve-64b8b86c9f-k7tsg"] Nov 04 01:58:26.643748 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:26.643716 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c9218427-91b8-49b2-951c-00654714c72f" path="/var/lib/kubelet/pods/c9218427-91b8-49b2-951c-00654714c72f/volumes" Nov 04 01:58:28.597505 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597474 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8"] Nov 04 01:58:28.597930 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597905 5537 cpu_manager.go:414] "containerMap: removing container" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" Nov 04 01:58:28.597930 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597917 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" Nov 04 01:58:28.597930 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597929 5537 cpu_manager.go:414] "containerMap: removing container" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597935 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597944 5537 cpu_manager.go:414] "containerMap: removing container" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597949 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597954 5537 cpu_manager.go:414] "containerMap: removing container" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597959 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597964 5537 cpu_manager.go:414] "containerMap: removing container" podUID="a9896732-3c47-4d0a-80d8-6e02c134dd18" containerName="maas-api" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597968 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9896732-3c47-4d0a-80d8-6e02c134dd18" containerName="maas-api" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597983 5537 cpu_manager.go:414] "containerMap: removing container" podUID="e59ed2e1-2c01-4b16-885a-b3535673a642" containerName="main" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597987 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e59ed2e1-2c01-4b16-885a-b3535673a642" containerName="main" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597994 5537 cpu_manager.go:414] "containerMap: removing container" podUID="c9218427-91b8-49b2-951c-00654714c72f" containerName="main" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.597998 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c9218427-91b8-49b2-951c-00654714c72f" containerName="main" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598003 5537 cpu_manager.go:414] "containerMap: removing container" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598007 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598014 5537 cpu_manager.go:414] "containerMap: removing container" podUID="b37e6df0-1c12-4a96-aa60-826a92462955" containerName="maas-api" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598019 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b37e6df0-1c12-4a96-aa60-826a92462955" containerName="maas-api" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598024 5537 cpu_manager.go:414] "containerMap: removing container" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598029 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598037 5537 cpu_manager.go:414] "containerMap: removing container" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598041 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598048 5537 cpu_manager.go:414] "containerMap: removing container" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598052 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598059 5537 cpu_manager.go:414] "containerMap: removing container" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" Nov 04 01:58:28.598055 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598064 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598073 5537 cpu_manager.go:414] "containerMap: removing container" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598078 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598084 5537 cpu_manager.go:414] "containerMap: removing container" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598089 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598097 5537 cpu_manager.go:414] "containerMap: removing container" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598101 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598107 5537 cpu_manager.go:414] "containerMap: removing container" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598110 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598116 5537 cpu_manager.go:414] "containerMap: removing container" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598120 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598169 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="b37e6df0-1c12-4a96-aa60-826a92462955" containerName="maas-api" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598176 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598182 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="a394a024-f25d-474b-aff6-0f4194bf0659" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598188 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598193 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598198 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="89a932f5-c594-4ca1-9f76-6551146d4209" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598203 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598209 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e64bc64-e882-441f-b82b-d5144a7bdea2" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598213 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598218 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="522a1ef4-7857-445b-94e0-bfa71bdf42e8" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598225 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="07aaebde-805e-4089-bca0-a58bd396fe97" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598231 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598235 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b6007de-bff5-4127-8cc9-5d0e9301ac4b" containerName="istio-proxy" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598240 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9896732-3c47-4d0a-80d8-6e02c134dd18" containerName="maas-api" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598247 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="e59ed2e1-2c01-4b16-885a-b3535673a642" containerName="main" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598252 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="c9218427-91b8-49b2-951c-00654714c72f" containerName="main" Nov 04 01:58:28.598723 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.598256 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b10fb3d-1f1c-401c-8fdb-78111c45fb94" containerName="istio-proxy" Nov 04 01:58:28.601167 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.601151 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.647431 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.647399 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5"] Nov 04 01:58:28.647986 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.647966 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b93cf7a-3a09-4643-8e00-30513a096dcb" containerName="istio-proxy" Nov 04 01:58:28.651064 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.651046 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.735961 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.735928 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.736248 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.736033 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.736248 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.736070 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgncz\" (UniqueName: \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-kube-api-access-zgncz\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.736248 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.736139 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.736248 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.736176 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.736248 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.736197 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.736655 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.736420 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.736655 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.736481 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.737427 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.736716 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.739834 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.739812 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5"] Nov 04 01:58:28.813982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.813944 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8"] Nov 04 01:58:28.837815 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.837765 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838001 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.837833 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.838001 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.837869 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.838001 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.837908 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.838001 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.837971 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.838209 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838091 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838209 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838170 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838209 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838198 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.838356 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838224 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838356 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838253 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838356 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838285 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgncz\" (UniqueName: \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-kube-api-access-zgncz\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838356 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838316 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838356 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838346 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838607 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838373 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.838607 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838407 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838607 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838445 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.838607 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838470 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlfgd\" (UniqueName: \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-kube-api-access-vlfgd\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.838607 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838487 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838607 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838501 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.838607 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838535 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838977 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838660 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.838977 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.838947 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.840104 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.840078 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.841048 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.841026 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.841569 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.841543 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.900039 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.899969 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.900166 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.900046 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgncz\" (UniqueName: \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-kube-api-access-zgncz\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.913898 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.913875 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:28.939707 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.939681 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.939877 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.939715 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.939877 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.939821 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.939986 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.939928 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.940038 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.939997 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.940038 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.940024 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfgd\" (UniqueName: \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-kube-api-access-vlfgd\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.940140 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.940058 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.940140 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.940125 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.940244 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.940159 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.940329 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.940287 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-credential-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.940527 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.940502 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-certs\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.940794 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.940764 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-socket\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.940964 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.940946 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-data\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.941184 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.941164 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istiod-ca-cert\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.942392 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.942364 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-podinfo\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:28.942976 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:28.942956 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-envoy\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:29.001222 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.001191 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlfgd\" (UniqueName: \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-kube-api-access-vlfgd\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:29.001374 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.001242 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-token\") pod \"e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:29.263392 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.263363 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:29.340080 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.340042 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8"] Nov 04 01:58:29.345683 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:58:29.345654 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b4ce6d_a289_4d00_9643_9e19d21d2c07.slice/crio-220ef749a3ebab434f7a9d27947fa4dff62f076ba09afe62e2537b8f276ab15f WatchSource:0}: Error finding container 220ef749a3ebab434f7a9d27947fa4dff62f076ba09afe62e2537b8f276ab15f: Status 404 returned error can't find the container with id 220ef749a3ebab434f7a9d27947fa4dff62f076ba09afe62e2537b8f276ab15f Nov 04 01:58:29.348596 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.348074 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:58:29.348596 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.348158 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:58:29.348596 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.348200 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:58:29.625830 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.625719 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" event={"ID":"c8b4ce6d-a289-4d00-9643-9e19d21d2c07","Type":"ContainerStarted","Data":"be680242d27d96db75f3c38c1abd1bf539501c35cc74c8689557f82bfb1c7436"} Nov 04 01:58:29.625830 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.625803 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" event={"ID":"c8b4ce6d-a289-4d00-9643-9e19d21d2c07","Type":"ContainerStarted","Data":"220ef749a3ebab434f7a9d27947fa4dff62f076ba09afe62e2537b8f276ab15f"} Nov 04 01:58:29.638991 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.638968 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5"] Nov 04 01:58:29.642018 ip-10-0-135-4 kubenswrapper[5537]: W1104 01:58:29.641990 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0cd6d7_6ecd_4424_b43b_45651c08f292.slice/crio-3dbf711e014ab597fb585f379f3d986e0b64b4995debf6acba2de4162e1a6d85 WatchSource:0}: Error finding container 3dbf711e014ab597fb585f379f3d986e0b64b4995debf6acba2de4162e1a6d85: Status 404 returned error can't find the container with id 3dbf711e014ab597fb585f379f3d986e0b64b4995debf6acba2de4162e1a6d85 Nov 04 01:58:29.644295 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.644263 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:58:29.644398 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.644338 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:58:29.644398 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.644388 5537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"} Nov 04 01:58:29.754434 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.754384 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" podStartSLOduration=1.75436798 podStartE2EDuration="1.75436798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:58:29.753135654 +0000 UTC m=+1399.225729947" watchObservedRunningTime="2026-11-04 01:58:29.75436798 +0000 UTC m=+1399.226962272" Nov 04 01:58:29.914724 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:29.914639 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:30.632883 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:30.632844 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" event={"ID":"3f0cd6d7-6ecd-4424-b43b-45651c08f292","Type":"ContainerStarted","Data":"0f03a097bfb09bd7832c142c3f90312004036a17e7923378ec8882baf060ab50"} Nov 04 01:58:30.633327 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:30.632903 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" event={"ID":"3f0cd6d7-6ecd-4424-b43b-45651c08f292","Type":"ContainerStarted","Data":"3dbf711e014ab597fb585f379f3d986e0b64b4995debf6acba2de4162e1a6d85"} Nov 04 01:58:30.834817 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:30.834234 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" podStartSLOduration=2.834218373 podStartE2EDuration="2.834218373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:58:30.829052762 +0000 UTC m=+1400.301647055" watchObservedRunningTime="2026-11-04 01:58:30.834218373 +0000 UTC m=+1400.306812665" Nov 04 01:58:30.916334 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:30.916245 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Nov 04 01:58:30.916334 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:30.916299 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Nov 04 01:58:31.267810 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:31.265127 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:31.277820 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:31.268922 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Nov 04 01:58:31.277820 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:31.268983 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Nov 04 01:58:31.914540 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:31.914503 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Nov 04 01:58:31.915086 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:31.914573 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Nov 04 01:58:32.270806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:32.267235 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Nov 04 01:58:32.270806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:32.267301 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Nov 04 01:58:32.915223 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:32.915185 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Nov 04 01:58:32.915638 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:32.915251 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Nov 04 01:58:33.270242 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:33.270203 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Nov 04 01:58:33.270558 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:33.270525 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Nov 04 01:58:33.914817 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:33.914758 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Nov 04 01:58:33.915013 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:33.914844 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Nov 04 01:58:34.267206 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:34.267168 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Nov 04 01:58:34.267839 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:34.267808 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Nov 04 01:58:34.915250 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:34.915208 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Nov 04 01:58:34.915462 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:34.915274 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Nov 04 01:58:35.277805 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:35.269012 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Nov 04 01:58:35.277805 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:35.269086 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Nov 04 01:58:35.914293 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:35.914255 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Nov 04 01:58:35.914473 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:35.914317 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Nov 04 01:58:36.264581 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:36.264546 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Nov 04 01:58:36.264751 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:36.264597 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Nov 04 01:58:37.955918 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:37.955879 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 01:58:37.956474 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:37.955945 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 01:58:38.265533 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:38.265498 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:38.266557 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:38.266532 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:38.305994 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:38.305956 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 01:58:38.306171 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:38.306034 5537 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 01:58:38.310646 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:38.310620 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:38.781805 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:38.781303 5537 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:38.795808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:38.785565 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:38.795808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:38.792905 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:50.493473 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:58:50.493436 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:58:51.537844 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:51.537735 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8"] Nov 04 01:58:51.538332 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:51.537971 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" containerID="cri-o://be680242d27d96db75f3c38c1abd1bf539501c35cc74c8689557f82bfb1c7436" gracePeriod=30 Nov 04 01:58:51.572745 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:51.572716 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59"] Nov 04 01:58:51.572950 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:51.572930 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" podUID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" containerName="istio-proxy" containerID="cri-o://83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0" gracePeriod=30 Nov 04 01:58:51.587317 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:51.587288 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5"] Nov 04 01:58:51.587490 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:51.587471 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" containerID="cri-o://0f03a097bfb09bd7832c142c3f90312004036a17e7923378ec8882baf060ab50" gracePeriod=30 Nov 04 01:58:53.268880 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:53.268837 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 01:58:53.269303 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:53.268902 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 01:58:53.784547 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:53.784513 5537 patch_prober.go:29] interesting pod/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Nov 04 01:58:53.786583 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:53.784579 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 01:58:56.846534 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.846498 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:58:56.870592 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.870556 5537 generic.go:356] "Generic (PLEG): container finished" podID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" containerID="83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0" exitCode=0 Nov 04 01:58:56.870836 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.870620 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" Nov 04 01:58:56.870836 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.870670 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" event={"ID":"ee703b6c-80b8-45d2-b63f-db45bea35d5f","Type":"ContainerDied","Data":"83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0"} Nov 04 01:58:56.870836 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.870718 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59" event={"ID":"ee703b6c-80b8-45d2-b63f-db45bea35d5f","Type":"ContainerDied","Data":"98b6159c6ad9f2bcb0acdfa208b776efa54d67d40f87bd12b58fd2357ca7ac2e"} Nov 04 01:58:56.870836 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.870748 5537 scope.go:122] "RemoveContainer" containerID="83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0" Nov 04 01:58:56.872658 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.872626 5537 generic.go:356] "Generic (PLEG): container finished" podID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerID="0f03a097bfb09bd7832c142c3f90312004036a17e7923378ec8882baf060ab50" exitCode=0 Nov 04 01:58:56.872749 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.872654 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" event={"ID":"3f0cd6d7-6ecd-4424-b43b-45651c08f292","Type":"ContainerDied","Data":"0f03a097bfb09bd7832c142c3f90312004036a17e7923378ec8882baf060ab50"} Nov 04 01:58:56.874645 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.874622 5537 generic.go:356] "Generic (PLEG): container finished" podID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerID="be680242d27d96db75f3c38c1abd1bf539501c35cc74c8689557f82bfb1c7436" exitCode=0 Nov 04 01:58:56.874747 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.874697 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" event={"ID":"c8b4ce6d-a289-4d00-9643-9e19d21d2c07","Type":"ContainerDied","Data":"be680242d27d96db75f3c38c1abd1bf539501c35cc74c8689557f82bfb1c7436"} Nov 04 01:58:56.880585 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.880567 5537 scope.go:122] "RemoveContainer" containerID="83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0" Nov 04 01:58:56.880922 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:58:56.880900 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0\": container with ID starting with 83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0 not found: ID does not exist" containerID="83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0" Nov 04 01:58:56.880986 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.880934 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0"} err="failed to get container status \"83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0\": rpc error: code = NotFound desc = could not find container \"83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0\": container with ID starting with 83cf9f8627fa2d99870f074dc8320195a51bd7f8ec1add67b591d3051da7cde0 not found: ID does not exist" Nov 04 01:58:56.909872 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.909850 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:56.911850 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.911835 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:56.955583 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955559 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-kube-api-access-xhk66\" (UniqueName: \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-kube-api-access-xhk66\") pod \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " Nov 04 01:58:56.955757 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955596 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-data\") pod \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " Nov 04 01:58:56.955757 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955617 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istiod-ca-cert\") pod \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " Nov 04 01:58:56.955757 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955646 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-envoy\") pod \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " Nov 04 01:58:56.955757 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955668 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-socket\") pod \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " Nov 04 01:58:56.955757 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955699 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-token\" (UniqueName: \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-token\") pod \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " Nov 04 01:58:56.955757 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955732 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-credential-socket\") pod \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955835 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-credential-socket\") pod \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955860 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-token\" (UniqueName: \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-token\") pod \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955884 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-certs\") pod \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955954 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-data\") pod \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955909 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-data" pod "c8b4ce6d-a289-4d00-9643-9e19d21d2c07" (UID: "c8b4ce6d-a289-4d00-9643-9e19d21d2c07"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.955990 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-podinfo\") pod \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956029 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-socket\") pod \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956063 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-certs\") pod \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956094 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-data\") pod \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956112 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-credential-socket" pod "ee703b6c-80b8-45d2-b63f-db45bea35d5f" (UID: "ee703b6c-80b8-45d2-b63f-db45bea35d5f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.956125 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956116 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-socket" pod "c8b4ce6d-a289-4d00-9643-9e19d21d2c07" (UID: "c8b4ce6d-a289-4d00-9643-9e19d21d2c07"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956132 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istiod-ca-cert" pod "c8b4ce6d-a289-4d00-9643-9e19d21d2c07" (UID: "c8b4ce6d-a289-4d00-9643-9e19d21d2c07"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956121 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-credential-socket\") pod \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956192 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-envoy\") pod \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956287 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istiod-ca-cert\") pod \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956315 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-credential-socket" pod "3f0cd6d7-6ecd-4424-b43b-45651c08f292" (UID: "3f0cd6d7-6ecd-4424-b43b-45651c08f292"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956322 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-credential-socket" pod "c8b4ce6d-a289-4d00-9643-9e19d21d2c07" (UID: "c8b4ce6d-a289-4d00-9643-9e19d21d2c07"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956319 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-certs\") pod \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956366 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-podinfo\") pod \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956405 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-envoy\") pod \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956484 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istiod-ca-cert\") pod \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956498 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-certs" pod "ee703b6c-80b8-45d2-b63f-db45bea35d5f" (UID: "ee703b6c-80b8-45d2-b63f-db45bea35d5f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956522 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-kube-api-access-zgncz\" (UniqueName: \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-kube-api-access-zgncz\") pod \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956559 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-socket\") pod \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\" (UID: \"ee703b6c-80b8-45d2-b63f-db45bea35d5f\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956608 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-kube-api-access-vlfgd\" (UniqueName: \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-kube-api-access-vlfgd\") pod \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956675 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-podinfo\") pod \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\" (UID: \"c8b4ce6d-a289-4d00-9643-9e19d21d2c07\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956717 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-token\" (UniqueName: \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-token\") pod \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\" (UID: \"3f0cd6d7-6ecd-4424-b43b-45651c08f292\") " Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.956765 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istiod-ca-cert" pod "ee703b6c-80b8-45d2-b63f-db45bea35d5f" (UID: "ee703b6c-80b8-45d2-b63f-db45bea35d5f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:58:56.957175 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.957143 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-socket" pod "ee703b6c-80b8-45d2-b63f-db45bea35d5f" (UID: "ee703b6c-80b8-45d2-b63f-db45bea35d5f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.958150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.957336 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-data" pod "ee703b6c-80b8-45d2-b63f-db45bea35d5f" (UID: "ee703b6c-80b8-45d2-b63f-db45bea35d5f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.958150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.957352 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istiod-ca-cert" pod "3f0cd6d7-6ecd-4424-b43b-45651c08f292" (UID: "3f0cd6d7-6ecd-4424-b43b-45651c08f292"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:58:56.958150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.957516 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-certs" pod "c8b4ce6d-a289-4d00-9643-9e19d21d2c07" (UID: "c8b4ce6d-a289-4d00-9643-9e19d21d2c07"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.958150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.957580 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-data" pod "3f0cd6d7-6ecd-4424-b43b-45651c08f292" (UID: "3f0cd6d7-6ecd-4424-b43b-45651c08f292"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.958150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.957695 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-socket" pod "3f0cd6d7-6ecd-4424-b43b-45651c08f292" (UID: "3f0cd6d7-6ecd-4424-b43b-45651c08f292"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.958150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.957726 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-certs" pod "3f0cd6d7-6ecd-4424-b43b-45651c08f292" (UID: "3f0cd6d7-6ecd-4424-b43b-45651c08f292"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.958150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958080 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958150 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958152 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958167 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958181 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958195 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958209 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958222 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958237 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958250 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958263 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958277 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958291 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958308 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958319 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.958575 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958330 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:56.959265 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.958985 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-token" pod "c8b4ce6d-a289-4d00-9643-9e19d21d2c07" (UID: "c8b4ce6d-a289-4d00-9643-9e19d21d2c07"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:58:56.959265 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.959032 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-kube-api-access-xhk66" pod "ee703b6c-80b8-45d2-b63f-db45bea35d5f" (UID: "ee703b6c-80b8-45d2-b63f-db45bea35d5f"). InnerVolumeSpecName "kube-api-access-xhk66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:58:56.959421 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.959379 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-envoy" pod "c8b4ce6d-a289-4d00-9643-9e19d21d2c07" (UID: "c8b4ce6d-a289-4d00-9643-9e19d21d2c07"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.959754 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.959693 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-podinfo" pod "ee703b6c-80b8-45d2-b63f-db45bea35d5f" (UID: "ee703b6c-80b8-45d2-b63f-db45bea35d5f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:58:56.960506 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.960482 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-envoy" pod "ee703b6c-80b8-45d2-b63f-db45bea35d5f" (UID: "ee703b6c-80b8-45d2-b63f-db45bea35d5f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:56.960603 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.960522 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-podinfo" pod "c8b4ce6d-a289-4d00-9643-9e19d21d2c07" (UID: "c8b4ce6d-a289-4d00-9643-9e19d21d2c07"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:58:56.960603 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.960585 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-podinfo" pod "3f0cd6d7-6ecd-4424-b43b-45651c08f292" (UID: "3f0cd6d7-6ecd-4424-b43b-45651c08f292"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 01:58:56.960854 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.960835 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-token" pod "3f0cd6d7-6ecd-4424-b43b-45651c08f292" (UID: "3f0cd6d7-6ecd-4424-b43b-45651c08f292"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:58:56.961000 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.960978 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-kube-api-access-zgncz" pod "c8b4ce6d-a289-4d00-9643-9e19d21d2c07" (UID: "c8b4ce6d-a289-4d00-9643-9e19d21d2c07"). InnerVolumeSpecName "kube-api-access-zgncz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:58:56.961099 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.961081 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-token" pod "ee703b6c-80b8-45d2-b63f-db45bea35d5f" (UID: "ee703b6c-80b8-45d2-b63f-db45bea35d5f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:58:56.961650 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.961632 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-kube-api-access-vlfgd" pod "3f0cd6d7-6ecd-4424-b43b-45651c08f292" (UID: "3f0cd6d7-6ecd-4424-b43b-45651c08f292"). InnerVolumeSpecName "kube-api-access-vlfgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:58:56.962120 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:56.962103 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-envoy" pod "3f0cd6d7-6ecd-4424-b43b-45651c08f292" (UID: "3f0cd6d7-6ecd-4424-b43b-45651c08f292"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:58:57.059733 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059697 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059733 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059726 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059742 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059755 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059766 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgncz\" (UniqueName: \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-kube-api-access-zgncz\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059775 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlfgd\" (UniqueName: \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-kube-api-access-vlfgd\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059798 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059806 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0cd6d7-6ecd-4424-b43b-45651c08f292-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059815 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhk66\" (UniqueName: \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-kube-api-access-xhk66\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059827 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059839 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee703b6c-80b8-45d2-b63f-db45bea35d5f-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.059982 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.059848 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8b4ce6d-a289-4d00-9643-9e19d21d2c07-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:58:57.418527 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.418493 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59"] Nov 04 01:58:57.422970 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.422944 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-jhl59"] Nov 04 01:58:57.881046 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.880956 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" Nov 04 01:58:57.881046 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.880981 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5" event={"ID":"3f0cd6d7-6ecd-4424-b43b-45651c08f292","Type":"ContainerDied","Data":"3dbf711e014ab597fb585f379f3d986e0b64b4995debf6acba2de4162e1a6d85"} Nov 04 01:58:57.881046 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.881044 5537 scope.go:122] "RemoveContainer" containerID="0f03a097bfb09bd7832c142c3f90312004036a17e7923378ec8882baf060ab50" Nov 04 01:58:57.882559 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.882470 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" Nov 04 01:58:57.882559 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.882502 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8" event={"ID":"c8b4ce6d-a289-4d00-9643-9e19d21d2c07","Type":"ContainerDied","Data":"220ef749a3ebab434f7a9d27947fa4dff62f076ba09afe62e2537b8f276ab15f"} Nov 04 01:58:57.891917 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:57.891900 5537 scope.go:122] "RemoveContainer" containerID="be680242d27d96db75f3c38c1abd1bf539501c35cc74c8689557f82bfb1c7436" Nov 04 01:58:58.044119 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:58.044086 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5"] Nov 04 01:58:58.093432 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:58.093400 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-cgjz5"] Nov 04 01:58:58.157002 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:58.156922 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8"] Nov 04 01:58:58.160643 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:58.160615 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-82706f-openshift-default-c4c5d579-zzjb8"] Nov 04 01:58:58.643732 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:58.643697 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" path="/var/lib/kubelet/pods/3f0cd6d7-6ecd-4424-b43b-45651c08f292/volumes" Nov 04 01:58:58.644223 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:58.644203 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" path="/var/lib/kubelet/pods/c8b4ce6d-a289-4d00-9643-9e19d21d2c07/volumes" Nov 04 01:58:58.644648 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:58:58.644629 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" path="/var/lib/kubelet/pods/ee703b6c-80b8-45d2-b63f-db45bea35d5f/volumes" Nov 04 01:59:20.492822 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:59:20.492717 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:59:38.711808 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:38.688728 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz"] Nov 04 01:59:38.717901 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:38.717872 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c"] Nov 04 01:59:38.734639 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:38.734587 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr"] Nov 04 01:59:50.492727 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:59:50.492690 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 01:59:53.758177 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:53.758132 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" podUID="d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" containerName="main" containerID="cri-o://e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464" gracePeriod=45 Nov 04 01:59:53.758598 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:53.758150 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" podUID="681d7509-57cd-477f-93c3-5dbc97f711d2" containerName="main" containerID="cri-o://f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145" gracePeriod=45 Nov 04 01:59:53.759030 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:53.758635 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" podUID="2227ce37-682e-409b-b5fe-867cd8848a0d" containerName="main" containerID="cri-o://2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a" gracePeriod=45 Nov 04 01:59:53.816498 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:53.816464 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" podUID="2227ce37-682e-409b-b5fe-867cd8848a0d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.38:8000/ready\": dial tcp 10.133.0.38:8000: connect: connection refused" Nov 04 01:59:53.871414 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:59:53.871375 5537 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2227ce37_682e_409b_b5fe_867cd8848a0d.slice/crio-conmon-2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a.scope\": RecentStats: unable to find data in memory cache]" Nov 04 01:59:53.940836 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:53.936540 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" podUID="681d7509-57cd-477f-93c3-5dbc97f711d2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": dial tcp 10.133.0.45:8000: connect: connection refused" Nov 04 01:59:54.045807 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.043179 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:59:54.046320 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.046299 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:59:54.066160 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.066133 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:59:54.113658 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.113629 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-dshm\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-dshm\") pod \"681d7509-57cd-477f-93c3-5dbc97f711d2\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " Nov 04 01:59:54.113658 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.113662 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/681d7509-57cd-477f-93c3-5dbc97f711d2-tls-certs\" (UniqueName: \"kubernetes.io/secret/681d7509-57cd-477f-93c3-5dbc97f711d2-tls-certs\") pod \"681d7509-57cd-477f-93c3-5dbc97f711d2\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " Nov 04 01:59:54.113901 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.113684 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-tmp-dir\") pod \"2227ce37-682e-409b-b5fe-867cd8848a0d\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " Nov 04 01:59:54.113901 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.113725 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-model-cache\") pod \"681d7509-57cd-477f-93c3-5dbc97f711d2\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " Nov 04 01:59:54.113901 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.113755 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-kube-api-access-4ztfs\" (UniqueName: \"kubernetes.io/projected/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-kube-api-access-4ztfs\") pod \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " Nov 04 01:59:54.113901 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.113797 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-home\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-home\") pod \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " Nov 04 01:59:54.113901 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.113825 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-dshm\") pod \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " Nov 04 01:59:54.113901 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.113882 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-model-cache\") pod \"2227ce37-682e-409b-b5fe-867cd8848a0d\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " Nov 04 01:59:54.114208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.113912 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-dshm\") pod \"2227ce37-682e-409b-b5fe-867cd8848a0d\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " Nov 04 01:59:54.114208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.113959 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-model-cache\") pod \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " Nov 04 01:59:54.114208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114011 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tmp-dir\") pod \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " Nov 04 01:59:54.114208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114037 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-model-cache" pod "681d7509-57cd-477f-93c3-5dbc97f711d2" (UID: "681d7509-57cd-477f-93c3-5dbc97f711d2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.114208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114065 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-tmp-dir" pod "2227ce37-682e-409b-b5fe-867cd8848a0d" (UID: "2227ce37-682e-409b-b5fe-867cd8848a0d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.114208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114081 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-home\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-home\") pod \"2227ce37-682e-409b-b5fe-867cd8848a0d\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " Nov 04 01:59:54.114208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114136 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tls-certs\") pod \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\" (UID: \"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9\") " Nov 04 01:59:54.114208 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114205 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/681d7509-57cd-477f-93c3-5dbc97f711d2-kube-api-access-s8dvw\" (UniqueName: \"kubernetes.io/projected/681d7509-57cd-477f-93c3-5dbc97f711d2-kube-api-access-s8dvw\") pod \"681d7509-57cd-477f-93c3-5dbc97f711d2\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " Nov 04 01:59:54.114617 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114241 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-home\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-home\") pod \"681d7509-57cd-477f-93c3-5dbc97f711d2\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " Nov 04 01:59:54.114617 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114272 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2227ce37-682e-409b-b5fe-867cd8848a0d-tls-certs\" (UniqueName: \"kubernetes.io/secret/2227ce37-682e-409b-b5fe-867cd8848a0d-tls-certs\") pod \"2227ce37-682e-409b-b5fe-867cd8848a0d\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " Nov 04 01:59:54.114617 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114308 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-home" pod "2227ce37-682e-409b-b5fe-867cd8848a0d" (UID: "2227ce37-682e-409b-b5fe-867cd8848a0d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.114617 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114317 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-home" pod "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" (UID: "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.114617 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114336 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-model-cache" pod "2227ce37-682e-409b-b5fe-867cd8848a0d" (UID: "2227ce37-682e-409b-b5fe-867cd8848a0d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.114617 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114362 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2227ce37-682e-409b-b5fe-867cd8848a0d-kube-api-access-6lmnh\" (UniqueName: \"kubernetes.io/projected/2227ce37-682e-409b-b5fe-867cd8848a0d-kube-api-access-6lmnh\") pod \"2227ce37-682e-409b-b5fe-867cd8848a0d\" (UID: \"2227ce37-682e-409b-b5fe-867cd8848a0d\") " Nov 04 01:59:54.114617 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114592 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-tmp-dir\") pod \"681d7509-57cd-477f-93c3-5dbc97f711d2\" (UID: \"681d7509-57cd-477f-93c3-5dbc97f711d2\") " Nov 04 01:59:54.115204 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.115029 5537 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-home\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.115204 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.115050 5537 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-tmp-dir\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.115204 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.115065 5537 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-model-cache\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.115204 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.115078 5537 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-home\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.115204 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.115091 5537 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-model-cache\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.116026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.114540 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-model-cache" pod "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" (UID: "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.116026 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.115305 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-tmp-dir" pod "681d7509-57cd-477f-93c3-5dbc97f711d2" (UID: "681d7509-57cd-477f-93c3-5dbc97f711d2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.116385 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.116275 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-home" pod "681d7509-57cd-477f-93c3-5dbc97f711d2" (UID: "681d7509-57cd-477f-93c3-5dbc97f711d2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.116385 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.116363 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tmp-dir" pod "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" (UID: "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.117893 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.117863 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/681d7509-57cd-477f-93c3-5dbc97f711d2-tls-certs" pod "681d7509-57cd-477f-93c3-5dbc97f711d2" (UID: "681d7509-57cd-477f-93c3-5dbc97f711d2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:59:54.117999 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.117917 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-dshm" pod "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" (UID: "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.118062 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.117986 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/681d7509-57cd-477f-93c3-5dbc97f711d2-kube-api-access-s8dvw" pod "681d7509-57cd-477f-93c3-5dbc97f711d2" (UID: "681d7509-57cd-477f-93c3-5dbc97f711d2"). InnerVolumeSpecName "kube-api-access-s8dvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:59:54.118062 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.117995 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2227ce37-682e-409b-b5fe-867cd8848a0d-kube-api-access-6lmnh" pod "2227ce37-682e-409b-b5fe-867cd8848a0d" (UID: "2227ce37-682e-409b-b5fe-867cd8848a0d"). InnerVolumeSpecName "kube-api-access-6lmnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:59:54.118293 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.118215 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-dshm" pod "681d7509-57cd-477f-93c3-5dbc97f711d2" (UID: "681d7509-57cd-477f-93c3-5dbc97f711d2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.118293 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.118261 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-kube-api-access-4ztfs" pod "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" (UID: "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9"). InnerVolumeSpecName "kube-api-access-4ztfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:59:54.118293 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.118273 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-dshm" pod "2227ce37-682e-409b-b5fe-867cd8848a0d" (UID: "2227ce37-682e-409b-b5fe-867cd8848a0d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 01:59:54.118293 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.118362 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2227ce37-682e-409b-b5fe-867cd8848a0d-tls-certs" pod "2227ce37-682e-409b-b5fe-867cd8848a0d" (UID: "2227ce37-682e-409b-b5fe-867cd8848a0d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:59:54.119630 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.119608 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tls-certs" pod "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" (UID: "d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:59:54.189681 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.189652 5537 generic.go:356] "Generic (PLEG): container finished" podID="2227ce37-682e-409b-b5fe-867cd8848a0d" containerID="2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a" exitCode=0 Nov 04 01:59:54.189890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.189721 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" Nov 04 01:59:54.189890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.189729 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" event={"ID":"2227ce37-682e-409b-b5fe-867cd8848a0d","Type":"ContainerDied","Data":"2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a"} Nov 04 01:59:54.189890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.189827 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr" event={"ID":"2227ce37-682e-409b-b5fe-867cd8848a0d","Type":"ContainerDied","Data":"98b166e343b6012ec5d639836b0b70a0b2649c1ccd0f34bfd50a47e15dd097fa"} Nov 04 01:59:54.189890 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.189851 5537 scope.go:122] "RemoveContainer" containerID="2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a" Nov 04 01:59:54.191377 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.191290 5537 generic.go:356] "Generic (PLEG): container finished" podID="681d7509-57cd-477f-93c3-5dbc97f711d2" containerID="f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145" exitCode=0 Nov 04 01:59:54.191377 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.191326 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" event={"ID":"681d7509-57cd-477f-93c3-5dbc97f711d2","Type":"ContainerDied","Data":"f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145"} Nov 04 01:59:54.191377 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.191345 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" Nov 04 01:59:54.191597 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.191385 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c" event={"ID":"681d7509-57cd-477f-93c3-5dbc97f711d2","Type":"ContainerDied","Data":"d8dd36166d4b7b69575e5d064af2496687d3acd7ec5a0741208fd0960f092b64"} Nov 04 01:59:54.195897 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.195872 5537 generic.go:356] "Generic (PLEG): container finished" podID="d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" containerID="e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464" exitCode=0 Nov 04 01:59:54.196002 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.195960 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" Nov 04 01:59:54.196002 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.195976 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" event={"ID":"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9","Type":"ContainerDied","Data":"e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464"} Nov 04 01:59:54.196081 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.196004 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz" event={"ID":"d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9","Type":"ContainerDied","Data":"1d5a93f7b82e46666a5ddedf2aa300844975ac3bbe1317ebf28bfc7d7140b066"} Nov 04 01:59:54.201563 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.201295 5537 scope.go:122] "RemoveContainer" containerID="2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a" Nov 04 01:59:54.202184 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:59:54.202154 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a\": container with ID starting with 2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a not found: ID does not exist" containerID="2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a" Nov 04 01:59:54.202265 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.202195 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a"} err="failed to get container status \"2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a\": rpc error: code = NotFound desc = could not find container \"2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a\": container with ID starting with 2ebe4bb5a07442d7c14d2dbef8a03359d3f54ed4eecbb18f36d5fb0d0e8ef73a not found: ID does not exist" Nov 04 01:59:54.202265 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.202218 5537 scope.go:122] "RemoveContainer" containerID="f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145" Nov 04 01:59:54.211839 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.211824 5537 scope.go:122] "RemoveContainer" containerID="f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145" Nov 04 01:59:54.212103 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:59:54.212086 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145\": container with ID starting with f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145 not found: ID does not exist" containerID="f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145" Nov 04 01:59:54.212160 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.212111 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145"} err="failed to get container status \"f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145\": rpc error: code = NotFound desc = could not find container \"f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145\": container with ID starting with f0a199d42c301fc70a7d3f356ea533f52bde2074c7064533a8c04cea70faa145 not found: ID does not exist" Nov 04 01:59:54.212160 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.212129 5537 scope.go:122] "RemoveContainer" containerID="e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217494 5537 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tls-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217530 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8dvw\" (UniqueName: \"kubernetes.io/projected/681d7509-57cd-477f-93c3-5dbc97f711d2-kube-api-access-s8dvw\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217547 5537 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-home\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217564 5537 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2227ce37-682e-409b-b5fe-867cd8848a0d-tls-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217578 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lmnh\" (UniqueName: \"kubernetes.io/projected/2227ce37-682e-409b-b5fe-867cd8848a0d-kube-api-access-6lmnh\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217598 5537 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-tmp-dir\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217611 5537 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681d7509-57cd-477f-93c3-5dbc97f711d2-dshm\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217624 5537 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681d7509-57cd-477f-93c3-5dbc97f711d2-tls-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217636 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ztfs\" (UniqueName: \"kubernetes.io/projected/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-kube-api-access-4ztfs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217654 5537 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-dshm\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217667 5537 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2227ce37-682e-409b-b5fe-867cd8848a0d-dshm\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217680 5537 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-model-cache\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.224806 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.217693 5537 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9-tmp-dir\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:54.227041 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.227023 5537 scope.go:122] "RemoveContainer" containerID="e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464" Nov 04 01:59:54.227918 ip-10-0-135-4 kubenswrapper[5537]: E1104 01:59:54.227703 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464\": container with ID starting with e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464 not found: ID does not exist" containerID="e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464" Nov 04 01:59:54.227918 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.227770 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464"} err="failed to get container status \"e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464\": rpc error: code = NotFound desc = could not find container \"e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464\": container with ID starting with e9c3f09c94bbef50d30061d5409ef917e3c8932e96e292d0822c862a09aa1464 not found: ID does not exist" Nov 04 01:59:54.500526 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.500500 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c"] Nov 04 01:59:54.503443 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.503407 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-w0-7af38e-kserve-6c6648b657-m2w8c"] Nov 04 01:59:54.642978 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.642948 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="681d7509-57cd-477f-93c3-5dbc97f711d2" path="/var/lib/kubelet/pods/681d7509-57cd-477f-93c3-5dbc97f711d2/volumes" Nov 04 01:59:54.646487 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.646463 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz"] Nov 04 01:59:54.653299 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.653276 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/distinct-2-w0-7af38e-kserve-7d45d7d4bb-72vkz"] Nov 04 01:59:54.761905 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.761828 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr"] Nov 04 01:59:54.765212 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:54.765185 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7af38e/simulator-w0-7af38e-kserve-55bd9c4467-vwmkr"] Nov 04 01:59:56.642680 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:56.642648 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2227ce37-682e-409b-b5fe-867cd8848a0d" path="/var/lib/kubelet/pods/2227ce37-682e-409b-b5fe-867cd8848a0d/volumes" Nov 04 01:59:56.643214 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:56.643093 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" path="/var/lib/kubelet/pods/d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9/volumes" Nov 04 01:59:59.399966 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.399923 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd"] Nov 04 01:59:59.400508 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.400134 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" podUID="ea5c525f-f973-4497-a1c7-e3c5ad90e06c" containerName="maas-api" containerID="cri-o://e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173" gracePeriod=30 Nov 04 01:59:59.675203 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.675176 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 01:59:59.774469 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.774439 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-openshift-service-ca\") pod \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " Nov 04 01:59:59.774644 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.774494 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-kube-api-access-l5gtt\" (UniqueName: \"kubernetes.io/projected/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-kube-api-access-l5gtt\") pod \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " Nov 04 01:59:59.774644 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.774617 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-maas-api-tls\") pod \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " Nov 04 01:59:59.774769 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.774704 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-metrics-certs\") pod \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\" (UID: \"ea5c525f-f973-4497-a1c7-e3c5ad90e06c\") " Nov 04 01:59:59.774949 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.774914 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-openshift-service-ca" pod "ea5c525f-f973-4497-a1c7-e3c5ad90e06c" (UID: "ea5c525f-f973-4497-a1c7-e3c5ad90e06c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 01:59:59.779123 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.775056 5537 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-openshift-service-ca\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:59.779814 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.779723 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-maas-api-tls" pod "ea5c525f-f973-4497-a1c7-e3c5ad90e06c" (UID: "ea5c525f-f973-4497-a1c7-e3c5ad90e06c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:59:59.781370 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.781085 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-kube-api-access-l5gtt" pod "ea5c525f-f973-4497-a1c7-e3c5ad90e06c" (UID: "ea5c525f-f973-4497-a1c7-e3c5ad90e06c"). InnerVolumeSpecName "kube-api-access-l5gtt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 01:59:59.790567 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.790308 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-metrics-certs" pod "ea5c525f-f973-4497-a1c7-e3c5ad90e06c" (UID: "ea5c525f-f973-4497-a1c7-e3c5ad90e06c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 01:59:59.876448 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.876414 5537 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-maas-api-tls\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:59.876448 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.876439 5537 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-metrics-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 01:59:59.876448 ip-10-0-135-4 kubenswrapper[5537]: I1104 01:59:59.876450 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5gtt\" (UniqueName: \"kubernetes.io/projected/ea5c525f-f973-4497-a1c7-e3c5ad90e06c-kube-api-access-l5gtt\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:00:00.228718 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:00.228685 5537 generic.go:356] "Generic (PLEG): container finished" podID="ea5c525f-f973-4497-a1c7-e3c5ad90e06c" containerID="e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173" exitCode=0 Nov 04 02:00:00.228924 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:00.228733 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" event={"ID":"ea5c525f-f973-4497-a1c7-e3c5ad90e06c","Type":"ContainerDied","Data":"e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173"} Nov 04 02:00:00.228924 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:00.228754 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" Nov 04 02:00:00.228924 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:00.228829 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd" event={"ID":"ea5c525f-f973-4497-a1c7-e3c5ad90e06c","Type":"ContainerDied","Data":"8dcf930f3acb42db6b2d87b09b21fd16460722d31e7ff895a1f1bdbf62edfe4c"} Nov 04 02:00:00.228924 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:00.228852 5537 scope.go:122] "RemoveContainer" containerID="e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173" Nov 04 02:00:00.238475 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:00.238456 5537 scope.go:122] "RemoveContainer" containerID="e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173" Nov 04 02:00:00.238725 ip-10-0-135-4 kubenswrapper[5537]: E1104 02:00:00.238703 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173\": container with ID starting with e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173 not found: ID does not exist" containerID="e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173" Nov 04 02:00:00.238804 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:00.238738 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173"} err="failed to get container status \"e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173\": rpc error: code = NotFound desc = could not find container \"e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173\": container with ID starting with e705638d7cffee033f47eb7b5a803ec95c8154865a9a5ffb544beb1b88524173 not found: ID does not exist" Nov 04 02:00:00.393827 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:00.393766 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd"] Nov 04 02:00:00.442917 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:00.442873 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7af38e-544fffdf7d-6x9qd"] Nov 04 02:00:00.642528 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:00.642493 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea5c525f-f973-4497-a1c7-e3c5ad90e06c" path="/var/lib/kubelet/pods/ea5c525f-f973-4497-a1c7-e3c5ad90e06c/volumes" Nov 04 02:00:07.941941 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:07.941904 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh"] Nov 04 02:00:07.942405 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:07.942122 5537 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" containerID="cri-o://445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f" gracePeriod=30 Nov 04 02:00:08.385053 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:08.385016 5537 patch_prober.go:29] interesting pod/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 02:00:08.385222 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:08.385080 5537 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 02:00:10.090772 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:10.090741 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-k45wc_856ccc57-5db4-42fa-bdc5-842e369cb24f/kuadrant-console-plugin/0.log" Nov 04 02:00:13.184704 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.184676 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 02:00:13.297153 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.297116 5537 generic.go:356] "Generic (PLEG): container finished" podID="d8846868-2b08-4ba6-9684-5362173836ae" containerID="445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f" exitCode=0 Nov 04 02:00:13.297350 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.297185 5537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" Nov 04 02:00:13.297350 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.297198 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" event={"ID":"d8846868-2b08-4ba6-9684-5362173836ae","Type":"ContainerDied","Data":"445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f"} Nov 04 02:00:13.297350 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.297277 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh" event={"ID":"d8846868-2b08-4ba6-9684-5362173836ae","Type":"ContainerDied","Data":"11d5da2294d345f8c16f95443c8dad136c609138216cdfd2229e30c75fed3b35"} Nov 04 02:00:13.297350 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.297299 5537 scope.go:122] "RemoveContainer" containerID="445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f" Nov 04 02:00:13.305745 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.305726 5537 scope.go:122] "RemoveContainer" containerID="5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d" Nov 04 02:00:13.310113 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310091 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-certs\") pod \"d8846868-2b08-4ba6-9684-5362173836ae\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " Nov 04 02:00:13.310200 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310150 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-credential-socket\") pod \"d8846868-2b08-4ba6-9684-5362173836ae\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " Nov 04 02:00:13.310261 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310206 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d8846868-2b08-4ba6-9684-5362173836ae-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8846868-2b08-4ba6-9684-5362173836ae-istio-podinfo\") pod \"d8846868-2b08-4ba6-9684-5362173836ae\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " Nov 04 02:00:13.310261 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310238 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-envoy\") pod \"d8846868-2b08-4ba6-9684-5362173836ae\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " Nov 04 02:00:13.310372 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310313 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-socket\") pod \"d8846868-2b08-4ba6-9684-5362173836ae\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " Nov 04 02:00:13.310372 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310343 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-data\") pod \"d8846868-2b08-4ba6-9684-5362173836ae\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " Nov 04 02:00:13.310372 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310349 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-certs" pod "d8846868-2b08-4ba6-9684-5362173836ae" (UID: "d8846868-2b08-4ba6-9684-5362173836ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:00:13.310372 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310365 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d8846868-2b08-4ba6-9684-5362173836ae-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8846868-2b08-4ba6-9684-5362173836ae-istiod-ca-cert\") pod \"d8846868-2b08-4ba6-9684-5362173836ae\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " Nov 04 02:00:13.310560 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310398 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-istio-token\" (UniqueName: \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-istio-token\") pod \"d8846868-2b08-4ba6-9684-5362173836ae\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " Nov 04 02:00:13.310560 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310425 5537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-kube-api-access-d6cpc\" (UniqueName: \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-kube-api-access-d6cpc\") pod \"d8846868-2b08-4ba6-9684-5362173836ae\" (UID: \"d8846868-2b08-4ba6-9684-5362173836ae\") " Nov 04 02:00:13.310560 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310451 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-credential-socket" pod "d8846868-2b08-4ba6-9684-5362173836ae" (UID: "d8846868-2b08-4ba6-9684-5362173836ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:00:13.310560 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310548 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-socket" pod "d8846868-2b08-4ba6-9684-5362173836ae" (UID: "d8846868-2b08-4ba6-9684-5362173836ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:00:13.310800 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310764 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8846868-2b08-4ba6-9684-5362173836ae-istiod-ca-cert" pod "d8846868-2b08-4ba6-9684-5362173836ae" (UID: "d8846868-2b08-4ba6-9684-5362173836ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 02:00:13.310878 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.310773 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-data" pod "d8846868-2b08-4ba6-9684-5362173836ae" (UID: "d8846868-2b08-4ba6-9684-5362173836ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:00:13.311973 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.311945 5537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:00:13.312079 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.311976 5537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-data\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:00:13.312079 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.311991 5537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8846868-2b08-4ba6-9684-5362173836ae-istiod-ca-cert\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:00:13.312079 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.312004 5537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-workload-certs\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:00:13.312079 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.312020 5537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-credential-socket\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:00:13.312830 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.312809 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-kube-api-access-d6cpc" pod "d8846868-2b08-4ba6-9684-5362173836ae" (UID: "d8846868-2b08-4ba6-9684-5362173836ae"). InnerVolumeSpecName "kube-api-access-d6cpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:00:13.313001 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.312978 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-envoy" pod "d8846868-2b08-4ba6-9684-5362173836ae" (UID: "d8846868-2b08-4ba6-9684-5362173836ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 02:00:13.313092 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.313075 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8846868-2b08-4ba6-9684-5362173836ae-istio-podinfo" pod "d8846868-2b08-4ba6-9684-5362173836ae" (UID: "d8846868-2b08-4ba6-9684-5362173836ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 02:00:13.313206 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.313185 5537 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-istio-token" pod "d8846868-2b08-4ba6-9684-5362173836ae" (UID: "d8846868-2b08-4ba6-9684-5362173836ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 02:00:13.314611 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.314590 5537 scope.go:122] "RemoveContainer" containerID="445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f" Nov 04 02:00:13.314906 ip-10-0-135-4 kubenswrapper[5537]: E1104 02:00:13.314884 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f\": container with ID starting with 445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f not found: ID does not exist" containerID="445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f" Nov 04 02:00:13.314998 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.314919 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f"} err="failed to get container status \"445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f\": rpc error: code = NotFound desc = could not find container \"445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f\": container with ID starting with 445802eadd1c5a59a0af792e6e12a89b54e7166d7d3450eeb265708395493f2f not found: ID does not exist" Nov 04 02:00:13.314998 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.314952 5537 scope.go:122] "RemoveContainer" containerID="5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d" Nov 04 02:00:13.315248 ip-10-0-135-4 kubenswrapper[5537]: E1104 02:00:13.315230 5537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d\": container with ID starting with 5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d not found: ID does not exist" containerID="5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d" Nov 04 02:00:13.315294 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.315255 5537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d"} err="failed to get container status \"5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d\": rpc error: code = NotFound desc = could not find container \"5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d\": container with ID starting with 5493d4f30bac8eadc15fa3a17c4f5921574ee815e347cc28780cf1642c0e449d not found: ID does not exist" Nov 04 02:00:13.413536 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.413506 5537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8846868-2b08-4ba6-9684-5362173836ae-istio-podinfo\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:00:13.413536 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.413531 5537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8846868-2b08-4ba6-9684-5362173836ae-istio-envoy\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:00:13.413536 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.413540 5537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-istio-token\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:00:13.413772 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.413549 5537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6cpc\" (UniqueName: \"kubernetes.io/projected/d8846868-2b08-4ba6-9684-5362173836ae-kube-api-access-d6cpc\") on node \"ip-10-0-135-4.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 02:00:13.717537 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.717502 5537 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh"] Nov 04 02:00:13.721147 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:13.721120 5537 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7af38e-openshift-default-765d77d66f-djfrh"] Nov 04 02:00:14.643111 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:14.643077 5537 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d8846868-2b08-4ba6-9684-5362173836ae" path="/var/lib/kubelet/pods/d8846868-2b08-4ba6-9684-5362173836ae/volumes" Nov 04 02:00:20.492883 ip-10-0-135-4 kubenswrapper[5537]: E1104 02:00:20.492845 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 02:00:42.302601 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:42.302570 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7dcf8fcc86-d56ln_09b6cc6a-6f61-484a-bd30-6b100b0acf46/maas-api/0.log" Nov 04 02:00:47.559439 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:47.559414 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-k45wc_856ccc57-5db4-42fa-bdc5-842e369cb24f/kuadrant-console-plugin/0.log" Nov 04 02:00:50.141317 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:50.141238 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-gjl74_f177de47-e18c-4c23-9555-6c2be8a45d50/discovery/0.log" Nov 04 02:00:50.492956 ip-10-0-135-4 kubenswrapper[5537]: E1104 02:00:50.492864 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 02:00:50.498105 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:50.498084 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84fbf4d7ff-8vkgx_e93aef59-ed70-4b8e-a31b-48d7c9636ab1/kube-auth-proxy/0.log" Nov 04 02:00:51.430186 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:51.430152 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-kh4xr_ecee57db-4ef6-4215-9447-c457d2018691/istio-proxy/0.log" Nov 04 02:00:51.969631 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:51.969601 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-nwszr_954d94ff-3308-4877-a781-e7f71513df5f/istio-proxy/0.log" Nov 04 02:00:52.258109 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:52.258084 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-p7nkd_bc18872f-d1f9-4510-950e-16a9d7c994b9/istio-proxy/0.log" Nov 04 02:00:55.772265 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:55.772234 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-hvhhm_cdf6f332-acf2-4ec4-95f3-5dd1eb4e0ad6/main/0.log" Nov 04 02:00:56.512573 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:56.512546 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8cmsql_2a01efc0-daf2-481b-b72a-c6540c36f226/main/0.log" Nov 04 02:00:56.813170 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:56.813094 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-kn75t_12bab359-8a85-42b0-aaee-04c084b86aed/main/0.log" Nov 04 02:00:57.056737 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:00:57.056705 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-5rb7k_6be8c900-640e-44c6-896b-411142151507/main/0.log" Nov 04 02:01:08.770155 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770115 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ldgg6/must-gather-qlz46"] Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770493 5537 cpu_manager.go:414] "containerMap: removing container" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770506 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770520 5537 cpu_manager.go:414] "containerMap: removing container" podUID="ea5c525f-f973-4497-a1c7-e3c5ad90e06c" containerName="maas-api" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770525 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea5c525f-f973-4497-a1c7-e3c5ad90e06c" containerName="maas-api" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770538 5537 cpu_manager.go:414] "containerMap: removing container" podUID="2227ce37-682e-409b-b5fe-867cd8848a0d" containerName="main" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770543 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2227ce37-682e-409b-b5fe-867cd8848a0d" containerName="main" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770550 5537 cpu_manager.go:414] "containerMap: removing container" podUID="d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" containerName="main" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770554 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" containerName="main" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770560 5537 cpu_manager.go:414] "containerMap: removing container" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770565 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770574 5537 cpu_manager.go:414] "containerMap: removing container" podUID="681d7509-57cd-477f-93c3-5dbc97f711d2" containerName="main" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770578 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="681d7509-57cd-477f-93c3-5dbc97f711d2" containerName="main" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770588 5537 cpu_manager.go:414] "containerMap: removing container" podUID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" containerName="istio-proxy" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770592 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" containerName="istio-proxy" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770603 5537 cpu_manager.go:414] "containerMap: removing container" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770607 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770658 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea5c525f-f973-4497-a1c7-e3c5ad90e06c" containerName="maas-api" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770668 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="2227ce37-682e-409b-b5fe-867cd8848a0d" containerName="main" Nov 04 02:01:08.770664 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770673 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8ab42c2-ad8d-4e7e-92d6-9451a175c7a9" containerName="main" Nov 04 02:01:08.771324 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770679 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f0cd6d7-6ecd-4424-b43b-45651c08f292" containerName="istio-proxy" Nov 04 02:01:08.771324 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770684 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="681d7509-57cd-477f-93c3-5dbc97f711d2" containerName="main" Nov 04 02:01:08.771324 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770691 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" Nov 04 02:01:08.771324 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770696 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee703b6c-80b8-45d2-b63f-db45bea35d5f" containerName="istio-proxy" Nov 04 02:01:08.771324 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770703 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8b4ce6d-a289-4d00-9643-9e19d21d2c07" containerName="istio-proxy" Nov 04 02:01:08.771324 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770763 5537 cpu_manager.go:414] "containerMap: removing container" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" Nov 04 02:01:08.771324 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770767 5537 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" Nov 04 02:01:08.771324 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.770858 5537 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8846868-2b08-4ba6-9684-5362173836ae" containerName="istio-proxy" Nov 04 02:01:08.773937 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.773922 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ldgg6/must-gather-qlz46" Nov 04 02:01:08.842796 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.842747 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a2c710c-cf99-4e26-86b9-e9caa5b1514b-must-gather-output\") pod \"must-gather-qlz46\" (UID: \"9a2c710c-cf99-4e26-86b9-e9caa5b1514b\") " pod="openshift-must-gather-ldgg6/must-gather-qlz46" Nov 04 02:01:08.842964 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.842909 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2jqc\" (UniqueName: \"kubernetes.io/projected/9a2c710c-cf99-4e26-86b9-e9caa5b1514b-kube-api-access-n2jqc\") pod \"must-gather-qlz46\" (UID: \"9a2c710c-cf99-4e26-86b9-e9caa5b1514b\") " pod="openshift-must-gather-ldgg6/must-gather-qlz46" Nov 04 02:01:08.889892 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.889858 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ldgg6\"/\"kube-root-ca.crt\"" Nov 04 02:01:08.889892 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.889880 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ldgg6\"/\"openshift-service-ca.crt\"" Nov 04 02:01:08.890105 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.889966 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ldgg6\"/\"default-dockercfg-wkhn6\"" Nov 04 02:01:08.891356 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.891337 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ldgg6/must-gather-qlz46"] Nov 04 02:01:08.943921 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.943887 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2jqc\" (UniqueName: \"kubernetes.io/projected/9a2c710c-cf99-4e26-86b9-e9caa5b1514b-kube-api-access-n2jqc\") pod \"must-gather-qlz46\" (UID: \"9a2c710c-cf99-4e26-86b9-e9caa5b1514b\") " pod="openshift-must-gather-ldgg6/must-gather-qlz46" Nov 04 02:01:08.944138 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.943946 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a2c710c-cf99-4e26-86b9-e9caa5b1514b-must-gather-output\") pod \"must-gather-qlz46\" (UID: \"9a2c710c-cf99-4e26-86b9-e9caa5b1514b\") " pod="openshift-must-gather-ldgg6/must-gather-qlz46" Nov 04 02:01:08.944271 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:08.944256 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a2c710c-cf99-4e26-86b9-e9caa5b1514b-must-gather-output\") pod \"must-gather-qlz46\" (UID: \"9a2c710c-cf99-4e26-86b9-e9caa5b1514b\") " pod="openshift-must-gather-ldgg6/must-gather-qlz46" Nov 04 02:01:09.004645 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:09.004614 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2jqc\" (UniqueName: \"kubernetes.io/projected/9a2c710c-cf99-4e26-86b9-e9caa5b1514b-kube-api-access-n2jqc\") pod \"must-gather-qlz46\" (UID: \"9a2c710c-cf99-4e26-86b9-e9caa5b1514b\") " pod="openshift-must-gather-ldgg6/must-gather-qlz46" Nov 04 02:01:09.088551 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:09.088471 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ldgg6/must-gather-qlz46" Nov 04 02:01:09.465672 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:09.465584 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ldgg6/must-gather-qlz46"] Nov 04 02:01:09.469680 ip-10-0-135-4 kubenswrapper[5537]: W1104 02:01:09.469654 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a2c710c_cf99_4e26_86b9_e9caa5b1514b.slice/crio-d89c512e9de90d99959c8600f8bd853732c99f8638865d4b9120a15fcb1220fc WatchSource:0}: Error finding container d89c512e9de90d99959c8600f8bd853732c99f8638865d4b9120a15fcb1220fc: Status 404 returned error can't find the container with id d89c512e9de90d99959c8600f8bd853732c99f8638865d4b9120a15fcb1220fc Nov 04 02:01:09.471597 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:09.471578 5537 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 02:01:09.546827 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:09.546764 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ldgg6/must-gather-qlz46" event={"ID":"9a2c710c-cf99-4e26-86b9-e9caa5b1514b","Type":"ContainerStarted","Data":"d89c512e9de90d99959c8600f8bd853732c99f8638865d4b9120a15fcb1220fc"} Nov 04 02:01:17.592676 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:17.592646 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ldgg6/must-gather-qlz46" event={"ID":"9a2c710c-cf99-4e26-86b9-e9caa5b1514b","Type":"ContainerStarted","Data":"decdb093bc47328408292c53cfe37092eb0c5b1b6955a51a34c579c280cfc559"} Nov 04 02:01:17.593165 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:17.592687 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ldgg6/must-gather-qlz46" event={"ID":"9a2c710c-cf99-4e26-86b9-e9caa5b1514b","Type":"ContainerStarted","Data":"9f82c01996038882a58701e82b5ec46ece0fc5b764ce0b212e82b781716437dd"} Nov 04 02:01:17.710544 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:17.710464 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-ldgg6/must-gather-qlz46" podStartSLOduration=2.628248507 podStartE2EDuration="9.710446614s" totalImagesPullingTime="7.082198107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:01:17.710047335 +0000 UTC m=+1567.182641627" watchObservedRunningTime="2026-11-04 02:01:17.710446614 +0000 UTC m=+1567.183040909" Nov 04 02:01:18.954177 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:18.954129 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rghpj_a265f44c-4a61-4dae-a06d-55472c7bdf21/global-pull-secret-syncer/0.log" Nov 04 02:01:20.493168 ip-10-0-135-4 kubenswrapper[5537]: E1104 02:01:20.493130 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 02:01:21.405469 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:21.405437 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c55hv_f700ff69-3257-4068-8eb2-807a7b9f150b/konnectivity-agent/0.log" Nov 04 02:01:22.791711 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:22.791675 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-4.us-west-1.compute.internal_c9d6b8a5b75c98b7e9c979c9bafacea9/haproxy/0.log" Nov 04 02:01:27.824934 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.824904 5537 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb"] Nov 04 02:01:27.830878 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.830860 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:27.883096 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.883063 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t4ldv\"/\"openshift-service-ca.crt\"" Nov 04 02:01:27.883287 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.883188 5537 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t4ldv\"/\"default-dockercfg-4lxxc\"" Nov 04 02:01:27.932910 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.932869 5537 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t4ldv\"/\"kube-root-ca.crt\"" Nov 04 02:01:27.934497 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.934471 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb"] Nov 04 02:01:27.935508 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.935489 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-proc\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:27.935563 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.935533 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-podres\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:27.935622 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.935559 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6nw2\" (UniqueName: \"kubernetes.io/projected/67937c40-9bf3-4d7c-85c3-a5e8e999a572-kube-api-access-f6nw2\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:27.935711 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.935693 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-lib-modules\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:27.935795 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:27.935733 5537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-sys\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.036551 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.036518 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-proc\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.036759 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.036565 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-podres\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.036759 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.036589 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6nw2\" (UniqueName: \"kubernetes.io/projected/67937c40-9bf3-4d7c-85c3-a5e8e999a572-kube-api-access-f6nw2\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.036759 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.036622 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-lib-modules\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.036759 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.036649 5537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-sys\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.036759 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.036661 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-proc\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.036759 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.036668 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-podres\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.036759 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.036725 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-lib-modules\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.036759 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.036728 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67937c40-9bf3-4d7c-85c3-a5e8e999a572-sys\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.097427 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.097354 5537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6nw2\" (UniqueName: \"kubernetes.io/projected/67937c40-9bf3-4d7c-85c3-a5e8e999a572-kube-api-access-f6nw2\") pod \"perf-node-gather-daemonset-dbrvb\" (UID: \"67937c40-9bf3-4d7c-85c3-a5e8e999a572\") " pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.143427 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.143394 5537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:28.212076 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.212044 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-k45wc_856ccc57-5db4-42fa-bdc5-842e369cb24f/kuadrant-console-plugin/0.log" Nov 04 02:01:28.525445 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.525414 5537 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb"] Nov 04 02:01:28.529486 ip-10-0-135-4 kubenswrapper[5537]: W1104 02:01:28.529458 5537 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod67937c40_9bf3_4d7c_85c3_a5e8e999a572.slice/crio-0dc7ea8b9784aae507fb95d8e3fc0a477bf05690d48d8aed4313a4dcc1f5bfcb WatchSource:0}: Error finding container 0dc7ea8b9784aae507fb95d8e3fc0a477bf05690d48d8aed4313a4dcc1f5bfcb: Status 404 returned error can't find the container with id 0dc7ea8b9784aae507fb95d8e3fc0a477bf05690d48d8aed4313a4dcc1f5bfcb Nov 04 02:01:28.657221 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:28.657166 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" event={"ID":"67937c40-9bf3-4d7c-85c3-a5e8e999a572","Type":"ContainerStarted","Data":"0dc7ea8b9784aae507fb95d8e3fc0a477bf05690d48d8aed4313a4dcc1f5bfcb"} Nov 04 02:01:29.664597 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:29.664559 5537 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" event={"ID":"67937c40-9bf3-4d7c-85c3-a5e8e999a572","Type":"ContainerStarted","Data":"5f70be7c761fe9d34411d85a08ac65596806156b942055707f290e34379d736c"} Nov 04 02:01:29.665018 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:29.664665 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:29.784916 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:29.784858 5537 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" podStartSLOduration=2.784843287 podStartE2EDuration="2.784843287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:01:29.784014434 +0000 UTC m=+1579.256608726" watchObservedRunningTime="2026-11-04 02:01:29.784843287 +0000 UTC m=+1579.257437638" Nov 04 02:01:32.276094 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:32.276058 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb1beaaa-e157-4914-be92-321101d0af4f/alertmanager/0.log" Nov 04 02:01:32.689557 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:32.689474 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb1beaaa-e157-4914-be92-321101d0af4f/config-reloader/0.log" Nov 04 02:01:33.105394 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:33.105368 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb1beaaa-e157-4914-be92-321101d0af4f/kube-rbac-proxy-web/0.log" Nov 04 02:01:33.520505 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:33.520478 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb1beaaa-e157-4914-be92-321101d0af4f/kube-rbac-proxy/0.log" Nov 04 02:01:33.935943 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:33.935861 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb1beaaa-e157-4914-be92-321101d0af4f/kube-rbac-proxy-metric/0.log" Nov 04 02:01:34.350233 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:34.350193 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb1beaaa-e157-4914-be92-321101d0af4f/prom-label-proxy/0.log" Nov 04 02:01:34.766717 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:34.766687 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb1beaaa-e157-4914-be92-321101d0af4f/init-config-reloader/0.log" Nov 04 02:01:35.679865 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:35.679837 5537 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t4ldv/perf-node-gather-daemonset-dbrvb" Nov 04 02:01:36.813650 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:36.813613 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-gjl74_f177de47-e18c-4c23-9555-6c2be8a45d50/discovery/0.log" Nov 04 02:01:36.862488 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:36.862453 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-844bd489c5-9phdj_7d1eb32a-767f-4594-86f0-2e757881d769/metrics-server/0.log" Nov 04 02:01:36.923147 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:36.923117 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84fbf4d7ff-8vkgx_e93aef59-ed70-4b8e-a31b-48d7c9636ab1/kube-auth-proxy/0.log" Nov 04 02:01:37.810696 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:37.810666 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-kh4xr_ecee57db-4ef6-4215-9447-c457d2018691/istio-proxy/0.log" Nov 04 02:01:38.241722 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:38.241647 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-nwszr_954d94ff-3308-4877-a781-e7f71513df5f/istio-proxy/0.log" Nov 04 02:01:38.456429 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:38.456398 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-p7nkd_bc18872f-d1f9-4510-950e-16a9d7c994b9/istio-proxy/0.log" Nov 04 02:01:38.977768 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:38.977741 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-76zqz_0681cec5-c66c-49fc-9694-1dd49f6696e5/node-exporter/0.log" Nov 04 02:01:39.395852 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:39.395822 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-76zqz_0681cec5-c66c-49fc-9694-1dd49f6696e5/kube-rbac-proxy/0.log" Nov 04 02:01:39.809683 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:39.809652 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-76zqz_0681cec5-c66c-49fc-9694-1dd49f6696e5/init-textfile/0.log" Nov 04 02:01:41.503707 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:41.503676 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-chzpl_b98854d2-7827-41a7-b636-5c7a95343ce5/kube-rbac-proxy-main/0.log" Nov 04 02:01:41.918297 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:41.918220 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-chzpl_b98854d2-7827-41a7-b636-5c7a95343ce5/kube-rbac-proxy-self/0.log" Nov 04 02:01:42.335441 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:42.335407 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-chzpl_b98854d2-7827-41a7-b636-5c7a95343ce5/openshift-state-metrics/0.log" Nov 04 02:01:44.441700 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:44.441675 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-k45wc_856ccc57-5db4-42fa-bdc5-842e369cb24f/kuadrant-console-plugin/0.log" Nov 04 02:01:46.918668 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:46.918640 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-579dd4fcbf-dsrgz_719ea48d-53c7-4bee-8ba3-e49b30c5f2db/telemeter-client/0.log" Nov 04 02:01:47.333258 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:47.333232 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-579dd4fcbf-dsrgz_719ea48d-53c7-4bee-8ba3-e49b30c5f2db/reload/0.log" Nov 04 02:01:47.747872 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:47.747742 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-579dd4fcbf-dsrgz_719ea48d-53c7-4bee-8ba3-e49b30c5f2db/kube-rbac-proxy/0.log" Nov 04 02:01:48.175202 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:48.175178 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b944f9c8b-bcwpk_82cb926a-b123-4eaf-88a7-f1c67e1ddf26/thanos-query/0.log" Nov 04 02:01:48.590601 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:48.590577 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b944f9c8b-bcwpk_82cb926a-b123-4eaf-88a7-f1c67e1ddf26/kube-rbac-proxy-web/0.log" Nov 04 02:01:49.007630 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:49.007602 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b944f9c8b-bcwpk_82cb926a-b123-4eaf-88a7-f1c67e1ddf26/kube-rbac-proxy/0.log" Nov 04 02:01:49.425017 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:49.424941 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b944f9c8b-bcwpk_82cb926a-b123-4eaf-88a7-f1c67e1ddf26/prom-label-proxy/0.log" Nov 04 02:01:49.839939 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:49.839914 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b944f9c8b-bcwpk_82cb926a-b123-4eaf-88a7-f1c67e1ddf26/kube-rbac-proxy-rules/0.log" Nov 04 02:01:50.254034 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:50.254006 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b944f9c8b-bcwpk_82cb926a-b123-4eaf-88a7-f1c67e1ddf26/kube-rbac-proxy-metrics/0.log" Nov 04 02:01:50.495042 ip-10-0-135-4 kubenswrapper[5537]: E1104 02:01:50.495008 5537 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dzv4w" containerName="extractor" Nov 04 02:01:51.766262 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:51.766228 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-gjl74_f177de47-e18c-4c23-9555-6c2be8a45d50/discovery/0.log" Nov 04 02:01:51.873566 ip-10-0-135-4 kubenswrapper[5537]: I1104 02:01:51.873542 5537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84fbf4d7ff-8vkgx_e93aef59-ed70-4b8e-a31b-48d7c9636ab1/kube-auth-proxy/0.log"